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ABSTRACT 

The  general  objective  of  the  proposed  research  was  to  determine  how 
reasoning  ability,  or  intellectual  capacity,  affects  gain  in  reading  ability. 
The  theory  underlying  the  present  research  was  that  poor  readers  consist' of 
two  types — those  who  read  poorly  because  of  deficits  in  their  reasoning 
ability  and  those  who  read  poorly  because  of  deficits  in  reading  practice, 
or  experience.  The  effect  of  reading  practice  upon  reading  ability  was 
investigated  using  high  school  students  who  read  poorly.  The  reading 
training  involved  a recently  developed  technique,  called  programmed  prose, 
which  allows  regular  reading  material  to  be  automatically  converted  into 
training  material.  Each  programmed  prose  passage  was  read  and  reread  until 
mastery  (100%  accuracy)  was  achieved.  A PLATO  IV  computer  terminal  was 
used  to  administer  the  programmed  prose  passages.  Each  student  was  given 
50  to  70  hours  of  individualized  instruction  on  the  terminal.  There  were 
three  separate  studies  with  six  high  school  students  in  each  study.  All 
students  were  at  about  grade  level  5 in  reading  ability  prior  to  the  instruc- 
tion. One  half  of  the  students  in  each  study  were  selected  because  they 
purportedly  had  high  reasoning  ability,  as  indicated  by  high  scores  on  the 
Raven  Progressive  Matrices  Test;  the  other  one  half  had  low  scores  on  this 
test.  The  results  were  consistent  across  all  three  studies.  The  high 
Raven  groups,  who  supposedly  had  high  reasoning  ability  and  should  benefit 
greatly  from  reading  training,  did  not  gain  more  than  the  low  Raven  groups. 
When  gain  in  reading  ability  was  measured  using  a test  that  was  just  like  the 
task  employed  in  the  reading  training,  there  was  a large  amount  of  gain — from 
grade  level  5 to  8.  However,  when  gain  in  reading  ability  was  measured 
using  other  techniques,  there  was  little  or  no  evidence  that  the  training, 
i.e.,  reading  practice,  produced  gain.  Also,  the  Raven  test  was  administered 
under  special  research  conditions,  and  the  results  suggested  that  the 
original  test  results,  which  were  used  to  divide  the  students  into  high  and 
low  groups,  may  not  have  been  valid.  This  research  failed  to  find  a re- 
lationship between  reasoning  ability  and  gain  in  reading  ability  but  this 
failure  could  have  been  due  to:  (a)  ineffective  techniques  used  to  pro- 

duce gains  in  reading  ability,  and  (b)  ineffective  techniques  used  to 
measure  reasoning  ability. 
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ABSTRACT 


Al 

The  general  objective  of  the  proposed  research  was  to  determine  how 
reasoning  ability,  or  intellectual  capacity,  affects  gain  in  reading  ability. 
The  theory  underlying  the  present  research  was  that  poor  readers  consist  of 
two  types--those  who  read  poorly  because  of  deficits  in  their  reasoning 
ability  and  those  wno  read  poorly  because  of  deficits  in  reading  practice, 
or  experience.  The  effect  of  reading  practice  upon  reading  ability  was 
investigated  using  high  school  students  who  read  poorly.  The  reading 
training  involved  a recently  developed  technique,  called  programmed  prose, 
which  allows  regular  reading  material  to  be  automatically  converted  into 
training  material.  . Each  programmed  prose  passage  was  read  and  reread  until 
mastery  (100%  accuracy)  was  achieved. >. A PLATO  IV  computer  terminal  was 
used  to  administer  the  programmed  prose  passages.  Each  student  was  given 
50  to  70  hours  of  individualized  instruction  on  the  terminal.  There  were 
three  separate  studies  with  six  high  school  students  in  each  study.  All 
students  were  at  about  grade  level  5 in  reading  ability  prior  to  the  instruc- 
tion. One  half  of  the  students  in  each  study  were  selected  because  they 
purportedly  had  high  reasoning  ability,  as  indicated  by  high  scores  on  the 
Raven  Progressive  Matrices  Test;  the  other  one  half  had  low  scores  on  this 
test.  The  results  were  consistent  across  all  three  studies.  The  high 
Raven  groups,  who  supposedly  had  high  reasoning  ability  and  should  benefit 
greatly  from  reading  training,  did  not  gain  more  than  the  low  Raven  groups. 
When  gain  in  reading  ability  was  measured  using  a test  that  was  just  like  the 
task  employed  in  the  reading  training,  there  was  a large  amount  of  gain — from 
grade  level  5 to  8.^  However,  when  gain  in  reading  ability  was  measured 
using  other  techniques,  there  was  little  or  no  evidence  that  the  training, 
i.e.,  reading  practice,  produced  gatm^  A I so,  the  Raven  test  was  administered 
under  special  research  conditions,  and  the  results  suggested  that  the 
original  test  results,  which  were  used  to  divide  the  students  into  high  and 
low  groups,  may  not  have  been  valid.  This  research  failed  to  find  a re- 
lationship between  reasoning  ability  and  gain  in  reading  ability  but  this 
failure  could  have  been  due  to:  (a)  ineffective  techniques  used  to  pro- 

duce gains  in  reading  ability,  and  (b)  ineffective  techniques  used  to 
measure  reasoning  ability. 
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INTRODUCTION 


In  1917,  Edward  L.  Th.  *ndike  analyzed  reading,  and  he  argued  that  reading 
was  basically  a reasoning  process.  In  1971,  Robert  L.  Thorndike  presented  cor- 
relational and  factor  analytic  data  of  individual  differences  which  he  inter- 
preted as  supporting  this  analysis  of  the  elder  Thorndike,  Robert  L.  Thorndike 
went  a step  further  and  argued  that  if  we  desire  better  readers,  the  challenge 
is  to  develop  ways  of  teaching  people  to  think  rather  than  concentrating  on 
reading.  He  concluded  that  it  is  primarily  meager  intellectual  processes  that 
are  limiting  reading  comprehension,  not  deficits  in  one  or  more  specific  and 
readily  teachable  skills. 

If  reading  is  primarily  reasoning  and  if  individual  differences  in  the 
ability  to  reason  do  account  for  almost  all  of  the  variation  in  individual  dif- 
ferences in  reading  ability,  then  is  reading  training  a waste  of  time  for  most 
poor  readers?  The  answer  to  this  theoretical  question  has  important  practical 
consequences.  Many  high  school  students  and  adults  are  extremely  poor  readers, 
i.e.,  they  are  described  as  functionally  illiterate.  The  question  is,  are  most 
of  these  people  poor  readers  because  they  are  poor  reasoners,  or  thinkers?  If 
so,  then  reading  instruction  is  likely  to  have  very  little  effect  upon  their 
reading  ability.  Policy  makers  in  training,  and  education  in  general,  should 
not  place  a great  deal  of  resources  into  reading  training  for  poor  readers  if 
these  theoretical  ideas  of  Thorndike  are  correct. 

It  would  seem  to  be  of  great  practical  benefit  to  anyone  concerned  with 
education  to  have  empirical  data  directly  relevant  to  the  above  theoretical  issue. 
What  is  the  relationship  between  reasoning  ability,  or  intellectual  capacity, 
and  improvement  in  reading  ability?  The  empirical  data  collected  up  to  now  has 
focused  upon  individual  differences  in  reading  ability  and  how  they  relate  to 
individual  differences  in  intellectual  capacity.  There  has  been  little  atten- 
tion given  to  research  that  is  directly  relevant  to  the  issue  in  question,  i.e., 
how  does  reasoning  ability,  or  intellectual  ability,  relate  to  w i th  i n- i nd  i v i dua 1 
ga  i n in  reading  ability. 

The  following  parts  of  this  introduction  section  will  present  the  back- 
ground for  an  empirical  study  of  ttv~  relationship  between  reasoning  ability  and 
gain  in  reading  ability. 

REASONING  ABILITY 


This  section  will  briefly  present  more  of  the  theoretical  background  under- 
lying the  investigation.  For  the  purposes  of  this  research,  reasoning  ability, 
intellectual  capacity,  and  intellectual  ability  will  be  regarded  as  synonomous. 

Palermo  and  Molfese  (1972)  found  that  mental  age  was  closely  related  to 
performance  measures  of  language  development  and  they  argued  that  "...a  theory 
of  language  development  must  be  embedded  within  the  larger  context  of  a theory 
of  cognitive  development  /p.  426/."  Crano,  Kenny,  and  Campbell  (1972)  carried 
this  idea  one  step  further  when  they  contended  that  their  data  indicate  that 
"...nonverbal  intelligence  causally  influences  verbal  IQ.,  an  ability  whidi,  i n_ 
turn,  is  a predictor  of  many  of  the  more  concrete  linguistic  skills... . /p . 272/ ." 
Singer  (1976)  argued  that  under  certain  conditions  IQ  was  likely  to  have  a sig- 
nificant relationship  with  the  ra te  of  acqu i s i t ion  of  a task. 

The  importance  of  conducting  research  in  this  area  has  been  articulated  by: 


1 


(a)  Harber  and  Bryen  (13  ?6 ) who  wrote  that  "...more  information  is  needed  con- 
cern i ng_other  variables  that  affect  reading  performance,  such  as  intelligence 
[_ p.  400/,  "and  (b)  Lohnes  and  Grey  (197?)  who  wrote  that  "^..reading  experts 
must  understand  intellegence  to  understand  reading  /p . 475,/." 

READING  PROCESS 


There  is  little  or  no  doubt  but  that  the  reading  process  does  involve 
interactions  with  such  constructs  as  thinking,  reasoning,  and  intellectual  ca- 
pacity. In  the  recent  past  a large  number  of  "models"  of  the  reading  process 
have  been  advanced  (see  review  by  Geyer,  1973).  and  none  of  these  models  suggest 
that  reading  is  exclusively  a type  of  rote  psychomotor  performance  that  does 
not  require  higher  order  intellectual  processes  such  as  reasoning.  8asic  intel- 
lectual competency  is  generally  implicitly  regarded  as  a "given"  in  such  dis- 
cussions. There  has  been  little  concern  for  how  individual  differences  in 
reasoning  ability  interact  with  the  reading  process.  Some  individuals  may  be 
better  able  to  comprehend  the  re  la t ionsh i ps  among  things  better  than  other  in- 
dividuals and  this  basic  intellectual  skill  may  simply  manifest  itself  in  the 
reading  situation,  i.e.,  a situation  which  involves  the  cognition  of  relations 
between  words. 

Carver  (1973)  has  isolated  levels  of  the  reading  process  as  described  in 
the  reading  literature  (see  Spache,  1963),  and  has  related  these  levels  to  in- 
tellectual functioning.  Level  1 is  associated  with  words  as  units  and  involves 
both  the  decoding  of  words  and  the  determination  of  their  meaning  as  used  in  the 
particular  sentence  being  read.  Level  2 is  associated  with  the  sentences  as 
units  and  involves  the  combination  of  the  meanings  of  the  individual  words  into 
the  complete  understanding  of  the  sentence.  Level  3 is  associated  with  the  par- 
agraph as  a unit  and  may  involve  such  processes  as  the  recognition  of  the  implied 
main  idea  of  a paragraph.  Level  4 is  associated  with  no  particular  unit  and  may 
involve  thinking  activities  which  are  riot  at  all  associated  with  the  literal, 
implied,  or  tangential  meanings  of  the  prose.  By  definition.  Levels  3 and  4 are 
primarily  reasoning  processes,  i.e.,  intellectual  functioning  processes  that  are 
not  inherent  or  specific  to  reading  and  do  not  occur  simultaneously  with  the 
reading  process  itself.  Therefore,  it  is  misleading  to  suggest  that  reading  is 
primarily  reasoning  when  reading  refers  to  Levels  3 and  4 because  Levels  3 and 
4 involve  reasoning  by  definition.  Levels  1 and  2 are  inherent  to  the  reading 
processes,  i.e.,  they  involve  an  ongoing  interaction  between  the  stimuli  per- 
ceived, i.e.,  the  words,  and  the  cognition  of  the  intended  meaning  of  these 
stimuli.  Levels  1 and  2 of  reading  do  not  involve  reasoning  ability  or  intel- 
lectual capacity  by  definition. 

In  summary,  the  essence  of  reading,  i.e.,  the  process  of  recognizing  .a 
intended  meaning  of  words  and  sentences  as  in  Levels  1 and  2 above,  is  a process 
which  would  seem  to  depend  upon  a fundamental  intellectual  ability  such  as  rea- 
soning. Therefore,  it  would  seem  that  differences  in  reasoning  ability  would 
place  limits  upon  the  reading  ability  of  individuals. 

READING  PROGRESS 


The  preceding  discussion  has  been  restricted  to  the  relationship  between 
reasoning  ability  and  the  reading  process  for  mature  readers,  i.e.,  individuals 
who  are  primarily  reading  to  learn  rather  than  learning  to  read.  In  most  learn- 
ing to  read  situations,  the  relationship  becomes  more  complex.  This  is  because 
most  of  the  individuals  who  are  learning  to  read  are  also  maturing  intellectually 
so  that  reasoning  ability  and  reading  ability  are  both  progressing  at  the  same 
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time.  Such  a dynamic  relationship  is  not  as  simple  to  scrutinize  and  to  ex- 
plain. An  explanation  of  these  complex  relationships  can  be  facilitated  using 
Carroll's  (1963)  model  of  school  learning.  This  model  will  be  described  briefly 
before  attempting  to  integrate  it  into  the  reading  situation. 

Carroll  envisioned  school  learning  as  being  influenced  by  five  primary 
factors.  Three  of  these  factors  were  internal  or  individual  difference  factors 
while  two  were  external  to  the  individual,  i.e.,  treatment  factors.  The  three 
individual  difference  factors  were:  (1)  apti tude--the  amount  of  time  needed 

to  learn  the  task  under  optimal  instructional  conditions,  (2)  ability  to  under- 
stand instruction,  and  (3)  perseverence — the  amount  of  time  the  individual  is 
willing  to  engage  in  learning.  The  two  treatment  factors,  or  external  factors, 
were:  (4)  opportun i ty-- t ime  allowed  for  learning,  and  (5)  the  quality  of  in- 

struction. Carroll  regards  his  aptitude  factor  as  relatively  resistant  to 
change  and  musters  support  for  this  stance  by  referring  to  the  research  which 
has  found  the  IQ.  to  be  relatively  constant.  Carroll  regards  his  second  factor, 
ability  to  understand  instruction,  as  a combination  of  general  and  verbal 
intelligence,  i.e.,_as  assessable  "...in  relative  terms  by  currently  available 
measuring  devices  [p . 12^/."  Carroll's  model  is  an  excellent  one  because  it 
focuses  upon  measurable  entities  which  allow  his  theory  to  be  empirically 
tested.  There  is  empirical  support  for  Carroll's  theory  (e.g.,  see  Carver,  1970). 

The  five  preceding  factors  are  considered  by  Carroll  as  influencing  the 
amount  of  time  the  learner  needs  to  master  the  learning  task.  Degree  of  learn- 
ing is  "...a  function  of  the  ratio  of  the  amount  of  time  tine  lea_rner  actually 
spends  on  the  learning  task  to  the  total  amount  he  needs  [p  . 730/."  Other 
things  being  equal,  degree  of  1 ea rn i ng . . . i s a simple  function_of  the  amount 
of  time  during  which  the  pupil  engages  actively  in  learning  [p  . Til/." 

POOR  READERS 


An  attempt  will  now  be  made  to  apply  the  preceding  theoretical  background 
to  a specific  reading  situation  of  great  practical  interest.  Why  do  some  students 
read  poorly?  It  is  hypothesized  that,  as  a group,  poor  readers  contain  two  gen- 
eral types;  each  type  reads  poorly  for  different  reasons. 

The  Type  I individual  reads  poorly  because  of  low  reasoning  ability.  This 
individual  may  have  a chronological  age  of  18  but  have  the  reasoning  ability  of 
a ten  year  old  and  read  at  a level  equivalent  of  that  of  a 10  year  old.  This 
person  only  reads  poorly  when  compared  to  other  individuals  of  the  same  chrono- 
logical age.  This  individual  may  be  considered  as  an  average  reader  if  compared 
to  other  individuals  of  the  same  reasoning  ability.  The  Type  I poor  readers  are 
the  type  that  Thorndike  (1971)  was  talking  about  when  he  contended  that  it  was 
primarily  meager  intellectual  skills  that  were  contributing  to  poor  reading  ar.d 
that  increases  in  reading  ability  are  not  likely  to  precede  increases  in  thinking 
ability.  In  Carroll's  model,  the  Type  I poor  reader  has  spent  the  amount  of  time 
needed  in  reading  situations.  This  individual's  poor  reading  does  not  result 
from  a lack  of  an  opportunity  to  read,  from  poor  instructional  quality,  or  from 
lack  of  personal  perseverence. 

The  Type  II  individual  reads  poorly  primarily  because  of  a lack  of  reading 
practice.  This  individual  has  not  spent  the  time  that  was  necessary  to  read  at 
a level  that  would  be  expected  from  his/her  intellectual  capacity.  There  are 
many  possible  reasons  why  this  type  of  individual  has  not  spent  a sufficient 
amount  of  time  reading.  Preschool  cultural  or  environmental  forces  may  have 
influenced  the  individual  to  focus  upon  physical  acitivites  rather  than  words 
and  language.  In  school,  the  individual  may  have  found  that  he  was  behind  and 
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that  catching  up  was  a difficult  and  time  consuming  task.  Furthermore,  he  may 
not  have  been  willing  to  persevere.  Upon  getting  behind  early,  the  school  in- 
struction also  may  have  been  inappropriate  to  the  individual's  level.  Therefore, 
even  the  effort  expended  by  the  individual  did  not  result  in  the  same  amount  of 
learning  as  peer  students  because  the  quality  of  the  instruction  was  not  optimal. 
This  interaction  between  poor  reading  (in  relationship  to  peers)  and  poor  in- 
struction (in  relationship  to  peers)  may  have  severly  discouraged  pa rt i c i pa t i on 
in  the  act  of  reading  to  the  point  where  reading  was  avoided  if  possible.  Such 
an  effect,  as  described  above,  would  multiply  the  disparity  between  an  individual 
and  his  peer  group.  It  is  theorized,  however,  that  the  ability  of  the  individual 
could  be  predicted  given  a knowledge  of  the  amount  of  time  the  individual  had 
engaged  in  the  reading  act  during  his  school  years.  That  is,  this  individual 
might  be  regarded  as  an  average  reader  when  his/her  total  amount  of  reading  ex- 
perience or  practice  is  compared  to  other  individuals  who  have  spent  comparable 
amount  of  time  reading. 

Stated  differently,  the  Type  I readers  are  considered  to  be  normal  achievers 
who  have  a level  of  reading  ability  which  is  commensurate  with  their  level  of 
reasoning  ability.  The  Type  II  readers  are  underachievers  who  are  reading  below 
their  potential  primarily  because  they  have  not  engaged  in  the  amount  of  reading 
practice  that  would  be  expected  from  their  years  in  school.  Using  the  parlance 
of  verbal  learning  theory,  the  amount  of  the  nominal  stimulus  (years  of  school 
instruction)  for  the  Type  II  individuals  is  an  overestimate  of  the  amount  of  the 
effective  stimulus  (years  of  reading  practice). 

There  is  a very  important  hypothesis  that  can  be  derived  from  Carroll's  theory 
which  is  directly  relevant  to  reading.  Carroll  mentioned  but  did  not  speculate 
upon  the  cumulative  effects  of  learning  different  tasks  and  how  this  factor 
interacted  with  time.  For  example,  suppose  Individual  A in  an  elementary  school  has 
a higher  reasoning  ability  than  Individual  B,  and  therefore  needs  less  time  to 
master  the  material  contained  in  one  of  the  basal  readers  used  for  instruction.  In- 
dividual A will  therefore  have  completed  that  particular  level  of  the  basal  reader 
series  and  be  working  on  a higher  level  while  Individual  B is  still  working 
at  the  same  level.  The  total  time  spent  reading  for  the  two  individuals  would 
be  equal  but  Individual  A would  have  progressed  to  a higher  level  of  reading  ability 
during  a fixed  amount  of  time.  From  Carroll's  model  it  could  be  hypothesized 
that:  (a)  equal  amounts  of  reading  practice,  from  a task-mastery  standpoint, 

would  result  in  equal  gains  in  reading  ability  no  matter  what  the  individuals' 
reasoning  ability,  and  (b)  equal  amounts  of  time  would  produce  unequal  amounts 
of  gain  in  reading  ability  depending  upon  the  individual's  reasoning  ability. 

The  above  theoretical  relationship  concerning  task-mastery  and  time  spent 
learning  will  now  be  integrated  into  the  previously  discussed  theoretical  differ- 
ence between  Type  I and  Type  II  poor  readers.  Suppose  a group  of  Type  I readers 
and  a group  of  Type  II  readers  were  given  a number  of  passages  that  they  must 
learn  to  read  to  a certain  criterion  level  of  accuracy.  The  task-mastery  hypo- 
thesis would  predict  that:  (a)  at  the  point  where  both  groups  had  mastered  the 

same  number  of  passages,  their  reading  ability  would  also  have  increased  to  an 
equivalent  level,  and  (b)  the  Type  II  readers  would  master  more  passages  in  an 
equal  amount  of  time  and  would  therefore  have  reached  a higher  level  of  reading 
ability  when  the  amount  of  time  engaged  in  reading  was  equal. 

In  summary,  it  is  theorized  that  poor  readers  are  of  two  types.  Both  types 
gain  equal  amounts  in  reading  ability  when  they  have  mastered  equal  amounts  of 
instructional  tasks.  However,  the  Type  I poor  readers  have  a higher  reasoning 
ability  and  this  results  in  their  gaining  more  than  the  Type  II  poor  readers 
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during  equal  amounts  of  time. 
MEASUREMENT  METHODS 


I n t roduct i on . In  order  to  test  this  hypothesized  relationship  between 
reasoning  ability  and  gain  in  reading  ability,  valid  measurement  techniques 
must  exist.  This  section  will  contain  a discussion  of  measurement  techniques 
to  be  used  to  provide  indicators  of  reasoning  ability,  reading  ability,  and 
degree  of  underachievement. 

i 

Reason i nq  Ability.  The  following  quotation  from  Robert  Gagne  (1973)  pro- 
vides a summary  of  knowledge  about  reasoning  ability,  or  intellectual  capacity: 

...there  are  vast  differences  in  the  capacity  for  learning 
among  different  individuals.  By  capacity  I mean  to  refer 
to  genetically  determined  intellectual  potential.  The 
exact  nature  of  these  differences  in  capacity  remains  a 
mystery  today,  despite  many_yea£S  of  investigation  into 
wha  t we  ca I 1 i n te 1 1 i gence  /p . 2/ . 

Although  there  may  be  a lack  of  consensus  about  how  one  should  measure  intel- 
lectual capacity,  or  reasoning  ability,  it  is  possible  and  reasonable  to  in- 
vestigate hypotheses  about  reasoning  ability  using  psychological  tests. 

At  this  point,  it  is  necessary  that  a clear  distinction  be  made  between 
reasoning  ability  and  IQ.  An  IQ  test  is  generally  regarded  as  measuring  intelli- 
gence, and  such  tests  normally  measure  intelligence  in  relationship  to  a normative 
group,  e.g.,  same  age  peers.  Intelligence,  as  measured  in  this  manner,  stays 
relatively  constant  from  childhood  to  adulthood.  However,  during  these  years  of 
constant  IQ,  reasoning  ability  increases  each  year.  In  this  sense,  reasoning 
ability  is  conceptually  equivalent  to  what  was  formerly  measured  by  Mental  Age, 
M.A.,  i.e.,  before  IQ  was  changed  to  a deviation  IQ. 

Existing  group  tests  of  intelligence  are  usually  contaminated  by  requiring 
an  ability  to  read.  One  group  test  which  does  not  require  reading  and  yet  appears 
to  be  an  excellent  measure  of  reasoning  ability  is  the  Raven  Progressive  Matrices 
Test.  It  consists  of  60  figures  with  parts  missing.  The  task  is  to  select  one 
of  the  alternatives  given  which  correctly  completes  the  figure.  The  figures 
involve  the  understanding  of  relationships  which  vary  from  extremely  easy  to 
extremely  difficult,  so  intellectual  capacity  can  be  measured  from  a mental  age 
of  about  8 on  up  to  maturity.  In  the  test  manual,  the  Raven  is  alternately  de- 
scribed as  providing  a measure  of  "reasoning,"  'clear  thinking,"  and  "intellectual 
capac  i ty ." 

The  Raven  has  been  considered  by  Charles  Spearman  (19^+6),  and  others  (see 
Vernon,  19^7;  Vincent,  1952;  Jensen,  1969)  as  the  best  of  the  nonverbal  tests 
for  measuring  general  intelligence.  In  Guilford's  (1967)  structure  of  the 
intellect,  the  Raven  is  considered  as  measuring  the  Cognition  of  Relations  bet- 
ween figures  (Figural).  Reading  would  be  considered  as  measuring  the  Cognition 
of  Relations  between  words  (Semantic).  That  is,  the  Raven  could  be  considered 
as  involving  the  same  type  of  mental  ability  as  read i ng--cogn i t ion  of  relations-- 
except  the  content  would  be  d i f ferent--f i gures  versus  words.  The  Raven  has  also 
been  used  in  studies  of  learning  proficiency  (e.g.,  see  Rohwer,  Ammon,  Suzuki, 
and  Levin,  1971),  and  a relatively  recent  administration  of  the  Raven  to  fraternal 
and  identical  twins  indicated  that  about  85%  of  the  variance  of  the  £ trait,  as 
estimated  by  this  test,  was  inherited  (Pezzullo,  Thorsen,  & Madans,  1972).  Nelson 
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and  Edelstein  (1963)  suggested  that  the  "...Raven  Progressive  Matrices  Test 
might  offer  an  additional  method  of  assessing  _the  intelligence  of  children 
with  language  and/or  cultural  handicaps  _/p.  46/." 

The  Raven  is  probably  the  best  available  group  test  to  use  to  estimate  an 
individual's  general  intellectual  ability  or  reasoning  ability,  especially  when 
the  ultimate  use  of  the  test  is  to  estimate  reading  potential  in  a manner  that 
does  not  involve  words. 

Read i ng  Ability.  Existing  standardized  tests  for  measuring  reading  achieve- 
ment suffer  from  two  interrelated  deficiencies.  First,  the  tests  have  been  de- 
signed to  be  maximally  efficient  in  reflecting  individual  differences  in  reading 
ability,  and  therefore  do  not  allow  performance  to  be  measured  on  an  interval 
or  ratio  scale.  Second,  by  selecting  items  which  best  discriminate  between 
individuals,  the  tendency  is  to  select  items  which  measure  reasoning,  inference, 
or  ability  to  think.  Therefore,  the  results  from  these  reading  tests  are  arti- 
factual  ly  contaminated,  usually  to  an  unknown  degree,  by  individual  differences 
in  reasoning  ability  (see  Carver,  1973).  Lohnes  and  Gray  (1972)  argued  that  in 
the  "...U.S.O.E.  Reading  Studies  measurements  were  overwhelmingly  saturated  with 
general  i n te  1 1 i gence  /_  p . 466/."  I f one  is  studying  the  relationship  between 
reasoning  ability  and  reading,  one  should  not  choose  a reading  test  which  had 
been  inadvertently  designed  to  reflect  reasoning  ability. 

Recently,  a test  has  been  developed  which  seems  to  overcome  both  of  the 
above  problems  (Carver,  1977a).  The  test  is  called  the  National  Reading  Stand- 
ards (NRS) . This  test  was  designed  to  measure  the  most  difficult  material  that 
I an  individual  can  accurately  read  in  a reasonable  length  of  time.  The  passages 

on  the  test  were  selected  to  reflect  a scale  of  difficulty  and  the  items  on  the 
test  were  objectively  chosen  using  an  algorithm  to  reflect  the  difficulty  of  the 
passaaes  (see  Carver  1975).  The  test  reflects  reading  ability  in  a manner  that 
is  relatively  independent  of  the  subjective  judgments  of  the  test  constructor 
and  not  a rt i factua 1 I y contaminated  by  reasoning  ability.  The  NRS  provides  a 
scale  which  measures  reading  ability  in  grade  level  units  so  that  a grade  level 
score  of  5 may  be  interpreted  as  indicating  that  the  individual  can  read  and 
understand  approximately  5C%  of  the  reading  material  that  is  written  at  the  fifth 
grade  level  of  difficulty. 

In  the  development  of  the  NRS,  described  above,  the  Raven  was  also  admin- 
istered to  the  same  students  as  was  the  NRS,  from  Grade  2 to  Grade  12.  Using 
these  data,  the  Raven  was  rescaled  to  provide  an  interval  scale  (see  Appendix 
A).  Also,  a grade  equivalent  score  was  developed  so  that  a Raven  raw  score  can 
1 be  converted  into  an  expected  reading  grade  level  (see  Appendix  B).  The  Type  I 

poor  readers  can  be  operationally  defined  as  those  who  have  an  actual  reading 
> ability  score,  from  the  NRS,  which  is  approximately  equal  to  their  expected 

reading  ability  score,  from  the  Raven.  Likewise,  the  Type  II  poor  readers  are 
those  who  have  an  actual  reading  ability  score  which  is  lower  than  their  expected 
reading  ability  score.  The  technique  used  for  converting  the  scores  from  the 
Raven  into  expected  reading  ability  scores  is  explained  in  detail  in  Appendix  B. 

1 READING  PRACTICE 

. 

Practice  seems  to  be  one  of  the  most  important  variables  affecting  com- 
plex cognitive  activities.  Simon  and  Chase  (1973)  studied  chess  players  and 
they  estimated  that  a master  chess  player  has  spent  around  10,000  to  50,000 
hours  staring  at  chess  positions  while  a Class  A players  has  only  spent  1,000 
to  5,000  hours  doing  this.  They  ask,  how  does  one  become  a master  in  the  first 
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place,  and  then  they  state: 


The  answer  is  practi ce — thousands  of  hours  of  pract i ce. . . .wha t 
is  needed  is  to  build  up  in  long-term  memory  a vast  repertoire  of 
patterns  and  associated  plausible  moves ....  such  a learning  process 
takes  t ime--yea rs-- to  build  up  _the  thousands  of  familiar  chunks 
needed  for  master  level  chess  fj> . 40J/. 

This  idea  about  the  importance  of  practice  has  also  been  applied  to  read- 
ing with  great  fervor  by  Smith  (1973).  He  states: 

All  proficient  readers  have  acquired  an  implicit  knowledge  of 
how  to  read,  but  this  knowledge  has  been  developed  through  the 
practice  of  reading,  not  through  anything  that  is  taught  at  school 
....Learning  to  read  is  not  a master  of  mastering  rules.  Children 
learn  to  read  by  reading  /p.  184/. 

Smith  elaborates  upon  this  point  in  another  publication  (1971): 

What  are  the  circumstances  in  which  the  skill  of  immediate 
meaning  identification  is  acquired?...!  can  sum  up  the  answer 
in  a single  word,  "experience"  (or  to  use  a slightly  more  tradi- 
tional term,  "practice").  Learning  to  read  is  akin  to  any  other 
skill;  there  are  perhaps  some  specialized  exercises  that  one  can 
undertake  to  iron  out  particular  difficulties,  but  there  is  no 
substitute  for  engaging  in  the  activity  itself.  Reading  involves 
looking  for  significant  differences  in  the  visual  configuration 
to  eliminate  alternatives,  and  knowledge  can  be  acquired  of  what 
differences  are  significant  only  through  experience.  This  know- 
ledge cannot  be  taught,  it  has  to  be  acquired;  the  major  contribu- 
tions that  the  teacher  can  make  are  to  provide  information,  feed- 
back, and  encouragement. 

The  theoretical  rationale  seems  straight  forward.  If  we  wish  to  help 
poor  readers  read  better,  we  should  get  them  to  practice  the  act  of  reading,  i.e. 
we  should  provide  reading  training  that  forces  the  students  to  engage  in  reading. 

Practicing  reading  is  seemingly  a simple  concept  but  it  is  not  simple 
to  actually  manipulate  reading  practice  in  an  experiment.  If  an  individual  is 
handed  a reading  passage  and  asked  to  read  it,  the  nominal  stimulus  is  straight 
forward,  but  the  effective  stimulus  is  largely  unknown.  Anderson  (1970)  quite 
simply  stated  the  problem  as  follows:  "One  cannot  be_sure  what  a student  is 

doing  when  he  is  looking  at  the  pages  of  a textbook  hp.  342/."  A solution  to 
this  problem  is  now  available  through  the  use  of  programmed  prose  materials 
(see  Carver,  1975).  An  example  of  programmed  prose  is  presented  in  Figure  1. 
Notice  that  an  individual  must  choose  which  words  belong  in  the  sentences  of 
a passage.  This  task  forces  an  individual  to  actively  engage  in  reading  and 
it  can  provide  feedback  to  the  experimenter  regarding  the  reader's  accuracy. 

When  the  programmed  prose  task  is  implemented  with  a computer,  it  is  aiso  pos- 
sible to  give  the  student  immediate  feedback;  the  correct  answer  to  each  item 
can  be  given  immediately  following  the  student's  choice.  A student  can  be  re- 
quired to  read  a passage  to  a certain  criterion  of  mastery,  such  as  100%  correct. 
With  this  technique,  it  is  possible  to  meaningfully  and  accurately  measure  the 
number  of  tasks  mastered,  mentioned  earlier  in  the  task-mastery  hypothesis.  Also 
by  recording  the  time  required  for  mastery  of  each  task,  the  total  amount  of 
time  spent  reading  can  also  be  measured.  Thus,  the  practice  theory  discussed 
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1.  An  example  of  a programmed  prose  passage. 
(Taxan  from  Carver,  1975). 


above  can  be  implemented  using  a computer  to  administer  the  programmed  prose 
technique. 

There  is  one  further  matter  to  be  discussed  relevant  to  practice.  It 
would  seem  that  the  practice  should  take  place  using  a level  of  material  dif- 
ficulty that  was  near  or  at  the  level  of  reading  ability  of  the  individual. 

Using  conventional  reading  ability  tests  and  conventional  reading  difficulty 
formulas,  it  is  not  as  simple  to  operationalize  this  idea  as  it  appears  to  be. 
This  is  because  conventional  reading  ability  tests  have  not  been  designed  to 
measure  ability  in  terms  of  the  level  of  material  difficulty  that  an  individual 
can  read.  The  NRS  test,  described  earlier,  has  a ready-made  solution  to  this 
problem  since  material  difficulty  and  individual  ability  are  measured  along  the 
same  scale.  Thus,  the  difficulty  of  the  material  used  to  train  readers,  the  abil 
i ty  of  the  readers,  and  the  expected  level  of  reading  ability  are  all  measured 
along  a measurement  scale  that  is  in  fact  equivalent  instead  of  being  superficall 
equivalent.  This  state  of  affairs  makes  research  much  more  precise  and  inter- 
nal ly  cons istent. 

EXISTING  DATA 


Any  time  a reading  test  and  an  intelligence  test  are  given  to  the  same 
group,  it  can  be  predicted  that  there  will  be  a high  correlation  between  the 
two.  For  example,  most  of  the  correlations  between  the  STEP  Reading  Test  and 
the  SCAT  Test  (an  intelligence  test)  are  reported  to  be  above  .80,  according  to 
the  manual  for  the  STEP  test.  It  is  for  this  reason  that  R.  L.  Thorndike  con- 
cluded that  poor  readers  are  poor  thinkers.  Yet,  there  is  a lack  of  good  evi- 
dence relevant  to  what  happens  when  poor  readers  practice  reading.  There  are 
a number  of  so  called  expentancy  formulas  in  reading  which  use  a measure  of 
intelligence  to  get  an  expected  grade  level  of  reading  ability.  However,  these 
formulas  are  usually  validated  by  correlating  them  with  actual  grade  levels  (e.g. 


see  Dore-Boyce,  Misner,  5-  McGuire,  1975).  What  is  needed  is  experimental 
evidence  regarding  whether  or  not  those  individuals  who  are  actually  reading  we  I 
below  their  expected  level  do  in  fact  gain  more  from  high  quality  instruction 
than  those  who  are  not  reading  below  their  expected  level. 

OVERVIEW  OF  METHOD 


Type  I and  Type  II  high  school  students  who  read  poorly  were  given  read- 
ing training.  The  training  consisted  of  reading  practice  using  a computer  ter- 
minal to  administer  the  programmed  prose  technique  described  earlier.  Part  of 
the  original  research  hypothesis  was  that  the  Type  II  readers  would  become  bette 
readers  as  a result  of  such  practice  since  it  was  hypothesized  that  the  primary 
reason  they  read  poorly  was  because  they  had  spent  little  time  reading.  The 
other  part  of  the  research  hypothesis  was  that  the  Type  II  readers  would  gain 
more  as  a result  of  the  training  than  the  Type  I because  the  reason  the  Type  I 
read  poorly  was  not  because  of  a lack  of  practice  but  because  of  a lower  intel- 
lectual capacity. 


All  the  students  for  the  research  were  selected  because  they  read  equally 
poorly.  However,  one-half  of  those  selected  had  high  scores  on  the  Raven  test, 
mentioned  earlier,  and  the  other  half  had  low  scores  on  this  test.  The  Low 
Raven  group  therefore  represented  the  Type  I poor  readers  and  the  High  Raven 
group  represented  the  Type  II  poor  readers. 


The  training  was  administered  using  a PLATO  IV  computer  terminal  which  pro- 
vided immediate  feedback  to  the  students  regarding  the  correctness  of  their  re- 
sponses and  automatically  monitored  progress;  a student  could  not  progress  to 
a subsequent  reading  passage  until  the  present  one  had  been  mastered  to  a 100% 
correct  criterion.  The  primary  advantage  of  the  PLATO  terminal  was  that  it 
provided  objective  and  reliable  control  of  the  practice.  The  primary  dis- 
advantage was  that  only  one  student  could  be  given  the  reading  training  at  any 
one  point  in  time.  Thus,  only  a few  students  could  be  given  the  training. 


The  research  was  conducted  in  three  studies.  Study 
for  an  8 week  summer  session,  July  and  August.  Study  II 
a semester,  September  to  December.  Study  III  involved  6 
semester,  January  to  April. 


I involved  6 students 
involved  6 students  for 
students  for  another 
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STUOY  I 


INTRODUCTION 


Although  there  was  pilot  data  collected  prior  to  Study  I,  this  study  was 
still  in  many  respects  a pilot  study  itself.  It  involved  the  first  group  of 
poor  reading,  high  school  students  who  were  administered  the  reading  training 
for  an  extended  period  of  time. 

METHOD 


Selection  of  Subjects.  The  six  subjects  involved  in  Study  I were  the  end 
result  of  a lengthy  selection  procedure. 

Two  local  high  schools  were  asked  to  cooperate  in  the  project.  A request 
was  made  to  each  school  to  select  students  in  grade  10  with  reading  levels  approxi- 
mately grade  3 through  grade  7.  In  one  school,  School  A,  the  reading  coordinators 
selected  such  tenth  grade  students  from  their  own  classes  and  they  also  asked 
the  teachers  in  the  English  classes  to  submit  names.  This  combination  of  efforts 
resulted  in  a list  of  64  individuals  who  were  invited  to  be  tested.  In  the  other 
school,  School  B,  the  counseling  department  used  teacher  and  counselor  records 
and  also  standardized  test  scores  to  select  students  from  grades  9,  10,  and  11 
who  probably  were  reading  around  grade  levels,  3 to  7.  This  effort  resulted  in 
a list  of  100  individuals  who  were  invited  to  be  tested. 

In  bovn  schools,  the  Paragraphs  Test  and  the  Vocabulary  Test  from  the  Lit- 
eracy Assessment  Battery  (Sticht  5-  Beck,  1976)  were  administered  to  the  selected 
students.  The  test  instructions  were  tape  recorded  for  standardization  and  con- 
venience in  administration.  The  entire  testing  required  only  about  50  minutes. 

In  School  A,  the  tests  were  administered  to  48  students  in  four  different 
groups.  In  School  B,  the  tests  were  administered  to  56  students  in  one  large 
group . 

There  is  a reading  and  auding  form  of  both  the  Paragraphs  Test  and  the 
Vocabulary  Test  so  there  were  a total  of  four  different  raw  scores.  Using  tables 
presented  in  the  test  manual,  each  raw  score  was  converted  into  a grade  equiva- 
lent score.  From  the  total  of  104  students  tested  in  both  schools,  the  40 
students  who  had  one  grade  level  score  less  than  6.5  on  one  of  the  two  reading 
test  were  invited  to  come  to  the  research  site  for  additional  testing. 

From  the  40  invited  for  additional  testing,  24  responded  and  participated. 

In  two  testing  sessionsf  these  24  students  were  administered  a battery  of  tests  — 
the  National  Reading  Standards,  Form  2A,  the  Raven  Progressive  Matrices  Test, 
the  National  Reading  Standards,  Form  3A , and  the  Vocabulary  section  of  Survey  D, 
Form  1,  Ga tes-McG i n i t i e Reading  Test.  They  were  paid  $5.00  for  two  hours  of 
testi ng. 

The  two  forms  of  the  National  Reading  Standards  jointly  provided  a single 
measure  of  reading  ability  in  grade  level  terms.  A rescoring  system  for  the 
Raven  Progressive  Matrices  Test  (see  Appendix  A and  Appendix  8)  provides  a 
measure  of  intellectual  ability  in  grade  level  terms.  The  score  on  the  Gates- 
McGinitie  also  provides  a measure  of  reading  vocabulary  in  grade  equivalents. 

The  final  6 students  selected  were  all  just  finishing  their  junior  year  of 
high  school  --  four  were  boys  and  two  were  girls.  These  six  students  all  were 
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reading  around  the  fifth  grade  level.  Their  grade  equivalents  in  reading  ability 
were  between  4 and  6 as  measured  by  either  the  National  Reading  Standards 
or  the  Ga tes-McG i n i t i e . Three  of  the  students  had  high  Raven  scores,  i.e., 
grade  equivalents  of  7-9,  and  three  of  the  students  had  low  Raven  scores, 
grade  equivalents  of  2-4.  Thus,  the  Raven  grade  equivalent  scores  from  3 of  the 
students  indicated  that  they  were  reading  at  a grade  level  that  was  approx- 
mately  commensurate  with  their  grade  level  of  reasoning  ability  (Low  Raven 
Group),  and  the  Raven  scores  from  the  other  three  students  indicated  that 
their  grade  level  of  reasoning  ability  level  was  higher  than  their  grade 
level  of  reading  ability  (High  Raven  Group). 

Procedures . The  students  came  for  training  sessions  that  lasted  two 
hours,  five  days  a week  for  8 weeks.  The  first  session  started  at  8:00  am 
and  the  last  session  ended  at  8:00  pm.  Each  student  came  every  day  at  the  same 
time  period  during  the  day. 

The  sessions  involved  interaction  with  the  PLATO  computer  (Bitzer,  Sherwood, 
& Teczar,  1973)  using  programs  developed  especially  for  this  reading  training 
project.  There  were  two  programs-- the  Measuring  Reading  Efficiency  (MRE)  prog- 
ram, and  the  Programmed  Prose  program  (PP).  These  programs  will  be  described 
in  a later  section.  The  MRE  program  was  administered  as  pre  and  post  tests 
for  the  PP  program;  this  measurement  program  was  not  successful  and  was  dis- 
continued after  Study  I. 

Passages . The  passages  used  as  reading  material  for  the  research  were 
selected  from  the  set  of  330,  100-word  passages  studied  by  Bormuth  (1969).  The 
passages  were  selected  from  actual  curriculum  materials  used  in  schools  from 
grade  1 through  college.  The  readility  of  these  passages  in  grade  equivalents 
has  been  measured  by  the  Rauding  Scale  (Carver,  1975-76).  For  the  present 
research,  ten  passages  were  randomly  selected  from  each  set  of  passages  at  each 
of  grade  levels,  2,  3,  4,  5,  6,  7,  8,  and  9 (on  the  Rauding  Scale),  giving 
a total  80  passages. 

Measuring  Reading  Efficiency  Program.  This  experimental  testing  program 
was  tried  out  for  the  first  time  with  these  subjects.  Each  set  of  10  passages 
at  each  grade  level  was  presented  for  different  periods  of  time  ranging  from  a 
very  short  length  of  time,  5 seconds,  to  a relatively  long  length  of  time,  2 min- 
utes. After  each  passage  had  been  presented,  there  were  10  test  items  presented 
one  at  a time.  Five  of  the  items  were  paraphrases  of  the  information  pre- 
sented in  each  1/5  of  the  passage.  When  a student  was  presented  one  of  these 
items,  the  student  should  have  depressed  a key  indicating  a "yes"  response  to 
the  question,  Does  this  sentence  say  about  the  same  thing  as  something  you  read 
in  the  passage?  The  other  5 items  were  "No"  items,  i.e.,  they  were  not  necessar- 
ily wrong  or  untrue  items  but  they  did  not  represent  information  that  was  con- 
tained in  the  passage  that  had  just  been  presented.  There  was  a No  item  written 
to  correspond  to  each  Yes  item,  i.e.,  two  items  for  each  part  of  the  passage, 

Part  1,  Part  2,  Part  3,  Part  4,  and  Part  5.  The  10  items  were  presented  in 
order  from  Part  1 to  Part  5 and  Part  1 to  Part  5 again  with  the  Y'es  or  No  item 
for  each  part  randomly  determined. 

This  type  of  test  turned  out  to  be  exceedingly  difficult  for  these  J5s , even 
for  grade  2 passages.  The  items  were  so  difficult  that  the  data  were  not  use- 
ful enough  to  present. 


Programmed  Prose  Program.  An  example  of  the  output  from  this  program  is 
presented  in  Fig.  2.  Every  fifth  word  was  an  item  choice.  In  this  example,  the 


This  is  our  Post  Office.  It  is  in  our 

city.  Many  people  work  here  There  is  a Post  Office 
in  every  city  in  our  country.  And  Post  Offices 

in  every  country  in  the  world. 

A Post  Office  helper  must  be  honest.  He  muaf 
be  a good  worker . A Post  0 f f i ce  he 1 per  hand  1 es 

lots  of  mail.  A Post  Office  helper  handles 

lots  of  money. 

The  Post  Office  sends  letters  and  packages, 
magazines,  and  newspapers  all  over  the  world. 

It  |o f «senos1  sma 1 1 animals  and  plants,  [hand  1 as » tool 

It  saves  money  for  |u3-»p  1 arrest  It  puts  money  to  liuork»moneyi 
for  us,  too. 

Pig.  2.  An  e-  of  th«  programmed  prose  task  as  implemented  by  the  pLAT0 

IV  computer  terminal. 


student  has  already  responded  to  the  first  16  items;  the  remaining  four  items 
are  represented  by  the  four  boxes  enclosing  the  four  pairs  of  words.  The  student's 
task  was  to  choose  either  the  right  or  left  word  as  best  fitting  into  the  sent- 
ence by  pushing  the  appropriate  key  on  the  right  or  left  side  of  the  keyboard 
in  front  of  them.  The  alternative  wrong  words  were  choosen  by  an  algorithm,  described 
in  detail  elsewhere  (Carver,  1975).  When  the  student  chose  the  correct  word 
for  an  item,  the  incorrect  word  and  the  box  simply  disappeared.  When  the  student 
chose  the  incorrect  words,  the  word  INCORRECT  flashed  briefly  immediately  below 
the  passage;  the  incorrect  word  and  the  enclosing  box  disappeared  as  soon  as 
INCORRECT  was  through  flashing.  After  a passage  had  been  completed,  a feedback 
page  appeared  with  the  following  information  given:  number  right,  total  number 

of  items,  time  taken  in  min.,  and  Rate  of  Good  Reading  (RGR)  score.  The  RGR 
score  is  a type  of  reading  efficiency  score  which  is  computed  from  a formula 
which  combines  the  accuracy,  rate,  and  grade  level  of  difficulty  of  the  passage. 

The  higher  the  accuracy,  the  higher  the  RGR  score.  The  faster  the  rate,  i.e., 
the  lower  the  amount  of  time  taken  to  complete  the  passage,  the  higher  the  RGR 
score.  The  more  difficult  the  passage,  the  higher  the  RGR  score.  The  formula 
itself  was  a modification  of  the  reading  efficiency  formula  presented  in  the 
manual  for  the  National  Reading  Standards.  That  formula  adjusted  for  the  dif- 
ficulty of  the  material  by  use  of  average  word  length.  The  present  formula 
uses  the  equations  given  by  Carver  ( 1 976 ; 1977a)  for  predicting  average  word 
length  from  grade  level  of  difficulty.  The  end  result  is  the  following  equation: 

RGR  - 1.468  (2.4R-1 ,2T) ( . 0787G+3 .861 ) + , 36  y (1) 


where  RGR 
R 
T 
G 

and  t 


s the  Rate  of  Good  Reading, 

s the  number  of  right  or  correct  items, 

s the  total  number  of  items  for  the  passage  (20  items), 

s the  grade  level  of  the  passage  as  rated  by  the  Rauding  Scale, 

s the  time  in  minutes  spent  working  on  the  items. 


Notice  that  the  lowest  possible  RGR  score,  at  an  infinitely  large  amount  of  time 
or  an  infinitely  low  rate,  is  136.7  words  per  minute.  Since  the  grade  level 
of  difficulty  of  the  passages,  G,  varied  only  from  2 to  9,  the  average  word 
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length  term  in  Equation  1 varied  only  from  4.0184  to  4.5693  character  spaces 
per  word  (see  Ca rver , 1 976) . Thus,  the  effect  of  the  grade  level  difficulty 
upon  RGR  varied  only  13. 7^^  from  the  grade  2 to  grade  9 training  materials. 

The  students  were  instructed  that  the  first  time  they  saw  a passage  they 
should  treat  it  as  a test:  "You  should  try  to  get  the  items  right;  you  should 

try  to  work  as  fast  as  you  can;  you  should  try  to  get  your  RGR  score  as  high 
as  possible."  After  the  first  trial  on  the  passage,  they  were  then  instructed 
to  take  their  time  and  try  to  get  all  of  the  items  correct.  They  then  kept 
working  on  a passage  until  they  got  all  the  items  correct.  Each  new  trial  on 
a passage  presented  the  same  passage  but  new  items.  There  were  five  different 
possible  sets  of  correct  items,  i.e.,  the  first  could  start  with  the  first 
word,  second  word,  third  word,  fourth  word,  or  fifth  word.  Even  if  two  trials 
on  a passage  involved  the  same  set  of  correct  answers,  the  wrong  answers  would 
be  different  since  for  each  new  trial  the  incorrect  alternatives  were  randomly 
selected,  with  certain  restrictions  (see  Carver,  1975),  from  the  surrounding 
text.  After  the  student  got  all  the  items  correct  (there  were  20  items),  then 
the  student  took  two  tests  on  the  passage  prior  to  going  onto  the  next  passage. 

The  instructions  for  the  tests  were  exactly  the  same  as  on  the  first  trial  and 
the  items  for  the  tests  were  selected  according  to  the  same  algorithms  used  on 
all  the  other  trials.  These  two  tests  also  gave  the  student  practice  in  going 
fast  immediately  prior  to  taking  the  test  upon  the  first  presentation  of  a new 
passage. 

The  students  proceeded  through  the  80  passages  in  order  of  difficulty  from 
grade  2 through  grade  9 with  the  order  of  the  10  passages  within  each  grade  level 
randomly  determined,  initially,  but  constant  and  the  same  for  all  students. 

After  each  trial,  the  student  recorded  the  data  from  the  feedback  page  onto 
a data  sheet.  These  data  sheets  provided  the  data  that  were  subsequently  ana- 
lyzed. These  data  were  also  recorded  by  the  computer  and  a hard  copy  printout 
allowed  the  accuracy  of  the  student  to  be  verified.  No  discrepancies  were  noted. 
When  the  data  had  been  recorded,  the  student  pressed  the  space  bar  on  the  key- 
board and  the  computer  started  preparing  the  next  passage  to  be  presented.  This 
required  about  20  to  30  sec.  depending  upon  the  load  upon  the  computer  at  that 
particular  time.  The  time  required  to  complete  a passage  ranged  from  about  1.5 
min.  to  3-0  min.  depending  upon  the  student's  rate  of  working.  The  intertrial 
interval  including  data  rec  rding  time  and  processing  time  for  the  computer  was 
around  .5  to  1.0  min. 

Order  of  Presentation  of  HRE  and  PP.  The  Grade  2 and  Grade  3 sets  of  10 
passages  were  considered  as  practice  by  the  experimenter  although  the  students 
were  not  told  this.  The  MRE  testing  on  Grade  2 and  Grade  3 passages  preceeded 
the  PP  activity  on  the  Grade  2 and  Grade  3 passages.  The  MRE  testing  on  sub- 
sequent passages  took  up  most  of  the  initial  sessions  but  PP  on  Grade  2 and  3 
was  also  initiated  during  the  initial  sessions.  The  grade  4-6  passages  were 
treated  as  one  block.  All  of  the  MRE  testing  on  grade  4-6  passages  had  been 
completed  prior  to  the  PP  activity  on  the  grade  4-6  passages.  When  the  PP 
activity  on  the  grade  4-6  passages  was  completed,  then  the  MRE  post  testing  on 
the  grade  4-6  passages  and  the  MRE  pretesting  on  the  grade  7-9  passages  was 
completed  prior  to  resumming  the  PP  activity.  When  the  PP  activity  was  com- 
pleted on  the  grade  7-9  passages  the  MRE  testing  on  that  block  of  passages  was 
i n i t ia  ted . 
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The  very  first  passage  presented  to  the  students,  i.e.,  the  first  Grade  2 
passage,  was  designated  as  a practice  passage.  This  practice  passage  was  presented 
prior  to  beginning  the  PP  each  session.  This  procedure  allowed  a warmup  to  a 
constant  criterion  of  performance  prior  to  the  continuation  of  the  PP  activity. 

Da  ta  Ana  lysis.  The  primary  variable  was  the  RGR  score  on  the  first  trial 
which  was  a test  trial  where  the  student  had  been  instructed  to  try  to  get  the 
RGR  score  as  high  as  possible  by  going  fast  without  making  very  many  mistakes. 

The  RGR  score  was  probably  the  best  index  of  whether  the  students  are  improving 
their  general  reading  ability.  This  measure  combines  rate  and  accuracy  so  any 
improvement  in  either  of  these  two  compoments  of  reading  efficiency  should  be 
reflected  in  this  score.  This  first  trial  RGR  will  be  called  the  PRETEST  RGR. 

The  other  two  variables  were  the  number  of  PASSAGES  MASTERED  and  the  amount 
of  time  spent  mastering  passages,  i.e.,  TOTAL  TIME.  The  PASSAGES  MASTERED 
variable  was  scaled,  for  convenience,  as  2,  3,  4,  5,  6,  7,  8,  and  9 with  these 
8 numbers  from  2 to  9 representing  the  10  passages  at  that  particular  grade 
level  of  difficulty,  e.g.,  "2"  designates  the  10  passages  at  grade  2 difficulty. 

For  data  analysis  purposes,  the  10  passages  at  each  grade  level  were  broken 
into  two  subsets  of  5.  The  median  RGR  score  for  each  consecutive  subset  of  5 
passages  was  the  primary  unit  of  analysis.  Thus,  there  were  two  blocks  of  five 
passages  at  each  grade  level  since  there  were  10  passages  at  each  grade  level 
altogether.  The  mean  of  these  two  medians  for  each  level  of  passage  difficulty, 
e.g.  2,  provided  an  indicator  of  the  typical  performance  of  the  individual  for 
that  set  of  10  passages;  the  indicator  of  typical  performance  for  each  of  the 
two  groups,  i.e.,  Low  Raven  and  High  Raven, was  obtained  by  calculating  the  mean 
of  these  three  means  for  the  three  individuals  in  each  group. 

The  TOTAL  TIME  variable  included  the  first  trial  test,  all  trials  to  mastery, 
and  the  two  post  tests.  The  total  time  for  the  first  block  of  10  passages,  for 
example,  was  simply  the  sum  of  the  total  times  for  each  of  the  first  10  passages. 
The  time  for  the  second  block  was  the  sum  of  the  times  for  the  first  block  and 
the  second  block,  i.e.,  the  total  time  spent  up  through  the  second  block.  Thus, 
the  TOTAL  TIME  variable  was  the  total  time  spent  on  the  reading  tasks  from  the 
beginning  up  through  each  successive  block  of  10  passages. 

RESULTS  AND  DISCUSSION 


Fig.  3 contains  the  PRETEST  RGR  scores  as  a function  of  PASSAGES  MASTERED 
for  the  Low  Raven  and  High  Raven  groups.*  For  example,  the  RGR  value  for  the 
High  Raven  group  on  the  grade  2 passages  (RGR=197)  was  the  mean  of  the  two  med- 
ian values  representing  the  first  and  second  block  of  5 passages  for  all  three 
students  in  the  High  Raven  group.  Notice  that  the  three  students  with  High 
Raven  scores  are  not  distinguishable  as  a group  from  the  students  with  low 
Raven  scores.  The  Low  Raven  group  did  start  out  somewhat  lower  but  as  more 
passages  had  been  mastered,  the  Low  Raven  group  improved  to  a point  where  their 
RGR  scores  were  slightly  higher  than  the  High  Raven  group.  This  result  is  in 
accordence  with  the  research  hypothesis  which  held  that  there  would  be  no  dif- 
ferences between  the  Low  Raven  group  and  the  High  Raven  group  when  the  number 
of  passages  mastered  was  held  constant. 


•'•'Note  that  the  scale  in  Fig.  3 seems  disproportionate.  This  scale  was  selected 
because  it  is  consistent  with  the  remainder  of  the  data  to  be  presented  in 
Study  I I and  Study  III. 
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Fig.  3.  Study  ).  RGR , *n  Worn,  as 
a function  of  oassage*  nascsfed  for  the  lov*  and 
High  Raven  grouos. 


In  Fig.  4,  the  PRETEST  RGR  scores  are  presented  as  a function  the  amount 
of  TOTAL  TIME.  These  data  do  not  present  results  that  are  significantly  dif- 
ferent from  those  in  Fig.  3.  The  High  Raven  group  is  not  distinguishable  from 
the  Low  Raven  group.  This  result  is  not  in  accordance  with  the  research  hypothe- 
sis. When  time  was  held  constant,  it  was  hypothesized  that  the  High  Raven 
group  would  gain  more  as  compared  to  the  Low  Raven  group.  There  is  no  evidence 
to  support  this  hypothesis  in  Fig.  4.  The  individuals  with  supposedly  lower 
reasoning  ability  seemed  to  gain  just  as  much  in  a fixed  amount  of  time  as  the 
group  of  individuals  with  supposedly  higher  reasoning  ability.  There  was  no 
evidence  in  Study  I to  support  the  research  hypothesis  regarding  Type  I and 
Type  II  poor  readers. 

It  is  possible  that  the  Raven  scores  for  this  group  were  not  reliable.  It 
could  be  that  some  of  the  students  in  the  Low  Raven  group  simply  did  not  try 
their  best  and  were  therefore  categorized  erroneously.  Eysenck  ( 1 966 ) states 
that  the  two  main  personality  factors  which  influence  performance  on  intelligece 
tests  j_|. . .may  be  called  by  their  popular  names,  carelessness  and  lack  of  persist- 
ence Ip.  16/."  Thus,  it  could  be  that  some  of  the  students  in  the  Low  Raven 
group  were  impulsive,  i.e.,  refused  to  persist  and  carelessly  answered  with  the 
first  answer  that  came  to  mind.  Before  rejecting  the  research  hypothesis  outlined 
at  the  outset,  it  seemed  prudent  to  focus  on  the  reliability  and  validity  of  the 
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Raven  test,  and  to  modify  the  experimental  procedures  in  other  ways  to  see 
if  these  results  were  replicable. 


STUDY  I I 


INTRODUCTION 


This  study  was  simlar  in  most  ways  to  Study  I;  however,  there  were  several 
important  differences. 

An  attempt  was  made  to  more  reliably  measure  reasoning  ability  with  the  Raven. 
The  method  of  adm i n i s ter i ng  this  test  in  the  selection  process  was  changed  in 
a manner  that  was  designed  to  elicit  greater  attention  from  the  students.  Also, 
the  Wechsler  Intelligence  Scale  for  Children  was  administered  to  the  students 
who  were  finally  selected  to  provide  anothermeasure  of  intellectual  ability. 

The  MRE  testing  was  eliminated  and  the  number  of  passages  that  were  to  be 
mastered  was  increased  from  80  to  160,  to  provide  more  reading  training  or  prac- 
tice. By  increasing  the  amount  of  training  time,  any  differences  that  in  fact 
exist  should  become  more  pronounced. 

There  were  other  differences  between  Study  I and  Study  II  which  will  be 
explained  in  the  method  section. 

METHOD 


Selection  of  Subjects.  Again,  the  six  subjects  involved  in  Study  II  were 
the  end  result  of  an  elaborate  selection  procedure.  The  procedure  was  similar 
to  what  was  used  in  Study  I but  deviated  in  certain  ways  as  will  be  described 
below. 


In  School  A,  the  reading  coordinator  positions  had  been  eliminated  over 
the  summer  and  the  two  reading  coordinators  had  been  assigned  to  teach  English 
classes.  The  initial  testing  involved  the  99  ninth  and  tenth  grade  students 
who  attended  the  first  four  English  classes  taught  by  one  of  the  former  read- 
ing coordinators  in  School  A.  Form  3A  of  the  National  Reading  Standards  was 
administered  to  these  classes.  Those  students  who  scored  at  grade  level  7 or 
higher  on  this  test  were  not  invited  for  further  testing.  After  this  group 
had  been  eliminated,  the  students  with  the  remaining  highest  50  scores  were 
invited  for  an  additional  testing  session  of  2 hours  duration  at  the  research 

site.  This  testing  was  conducted  after  school  hours  in  three,  2-hour  sessions, 

and  the  students  were  paid  $5.00  for  their  part i cpa t i on . A total  of  28  students 
participated  in  this  phase  of  the  testing.  Each  student  was  administered  the 
National  Reading  Standards,  Form  2A , the  Raven  Progressive  Matrices  Test,  and 
the  Vocabulary  section  of  Survey  D,  Form  1,  of  the  Ga tes-McG i n i t i e Reading  Test. 
The  preceeding  tests  were  also  administered  in  Study  I.  However,  in  Study  II, 
the  Raven  test  was  administered  in  a manner  that  deviated  from  the  standarized 
procedures.  After  the  test  had  been  administered  once  in  the  standard  manner, 
it  was  scored  and  the  students  were  asked  to  take  it  again  toward  the  end  of  the 
same  2-hour  testing  session.  The  second  time,  they  were  given  an  answer 

sheet  which  nad  the  ones  they  had  missed  the  first  time  marked  with  an  X.  Thus, 

they  could  see  how  many  they  got  right  and  which  items  they  got  wrong  but 
they  had  no  clue  as  to  which  specific  alternatives  were  right  or  wrong.  This 
information  by  itself  should  not  have  much  of  an  effect  upon  the  scores  because 
the  Raven  has  6 alternative  answers  for  the  first  24  items  and  8 alternative 
answers  for  the  remaining  36  items. 

The  six  subjects  finally  selected  were  all  reading  at  the  fourth,  fifth 
or  sixth  grade  levels  according  to  both  the  NRS  test  and  the  Ga tes-McG i n i t i e 
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Vocabulary  test.  Three  of  the  subjects  had  high  Raven  scores,  8-9  (High  Raven 
group),  and  three  had  Low  Raven  scores,  3“5  (Low  Raven  group),  as  measured  by 
the  second  adm i n i s t ra t i on  of  the  Raven.  The  six  subjects  were  all  starting  either 
their  ninth  or  tenth  grade  in  schoo 1 -- th ree  were  boys  and  three  were  girls. 

Procedures . Each  student  came  for  a two-hour  session,  three  days  a week. 

The  sessions  were  scheduled  from  3:30  to  9'-30  pm,  daily  and  from  12:00  to  6:00 
pm.  on  Saturday.  The  subjects  came  at  the  same  time  periods  each  week--three 
came  Monday,  Wednesday,  and  Friday,  and  three  came  Tuesday,  Thursday,  and 
Saturday. 

As  mentioned  earlier,  there  were  no  MRE  activities  in  Study  II.  The 
programmed  prose  activity  for  each  passage  was  exactly  the  same  as  was  outlined 
in  Study  I but  there  were  changes  in  the  overall  PP  treatment.  In  Study  I, 
the  experimenter  considered  the  Grade  2 and  Grade  3 sets  of  10  passages  as  prac- 
tice. In  Study  II,  there  was  no  practice  except  for  the  first  passage--the  prac- 
tice passage;  there  was  no  practice  from  either  the  subject's  standpoint  or  the 
experimenter's  standpoint.  The  first  80  passages,  passage  Set  A,  were  exactly 
the  same  as  in  Study  I.  The  next  80  passages,  Passage  Set  B,  paralleled 
the  first  set  and  were  selected  the  same  way  as  the  first  set;  no  overlap 
between  sets  was  allowed.  When  a subject  finished  the  last  passage  in  Set  A, 
i.e.,  a passage  at  the  ninth  grade  level,  then  the  subject  was  started  immedi- 
ately on  the  first  passage  on  Set  B,  i.e.,  a passage  at  the  second  grade  level. 
Again,  the  student  always  started  out  each  session  with  the  practice  passage. 

The  fastest  student  in  the  group  completed  the  80  passages  in  17  sessions 
and  the  slowest  student  took  sessions.  When  the  faster  students  finished 
they  were  asked  to  Start  all  over  again  at  the  beginning  to  keep  them  participating 
in  the  project.  All  students  completed  at  least  28  sessions. 

Wechsler  Testing.  The  Wechsler  Intelligence  Scale  for  Children  (W ISC) 
was  administered  to  each  of  the  6 students  toward  the  end  of  their  first  month 
of  participation.  It  was  administered  by  a research  assistant  on  the  project. 

Data  Analyses.  The  data  analysis  procedures  were  similar  to  those  in 
Study  I but  were  much  more  intensive.  Although  the  posttesting  on  each  passage 
acted  primarily  as  a warmup  for  the  pretesting  on  the  subsequent  passage,  the 
data  from  the  posttesting  also  reflects  gain  in  efficiency  of  performance  as 
a result  of  practice.  Similarly,  the  practice  passage  that  was  administered 
at  the  beginning  of  each  2 hours  session  was  presented  primarily  as  a warmup 
but  the  RGR  data  from  this  passage  also  reflects  performance  gain.  Therefore, 
the  higher  of  the  two  posttest  RGR  values  for  both  the  regular  passages  and 
the  practice  passage  were  analyzed  in  Study  II;  this  variable  was  called  the 
POSTTEST  HIGHER  RGR. 

Also  in  this  study,  the  components  of  certain  variables  were  anlayzed.  The 
time  and  accuracy  components  of  the  first  trial  RGR  was  analyzed,  i.e.,  the 
PRETEST  TIME  variable  and  the  PERCENT  ACCURACY  variable.  The  PERCENT  ACCURACY 
variable  was  actually  a corrected  value,  i.e.,  using  the  correction  for  guessing 
formula — rights  minus  wrongs.  In  addition  to  analyzing  the  total  time  taken  on 
each  passage,  the  number  of  trials  required  to  reach  mastery  was  also  analyzed. 

This  latter  variable  was  called  TRIALS  TO  MASTERY. 

GROUP  RESULTS  AND  DISCUSSION 

In  Fig.  5,  the  POSTTEST  HIGHER  RGR  values  on  the  initial  practice  passage 
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for  each  session  have  been  presented  for  the  Low  Raven  and  High  Raven  groups. 

On  the  average,  these  students  started  at  around  220  words  per  minute  after 
mastery  of  the  practice  passage  and  steadily  improved  to  about  400  words  per 
min.  Notice  that  both  groups  start  out  almost  exactly  equal  (220  and  221)  but 
the  Low  Raven  group  consistently  does  better  than  the  High  Raven  group  from 
about  session  12  on.  These  data  indicate  that  both  groups  consistently  im- 
proved the  speed  at  which  they  could  complete  this  practice  passage.  These 
data  also  indicate  that  these  groups  have  an  ultimate  potential  of  around  400 
words  per  minute  for  RGR  performance.  This  means  that  any  RGR  scores  lowar 
than  this  reflects  the  amount  of  thinking  or  reasoning  time  required  to  process 
a less  familar  passage  as  opposed  to  a ceiling  imposed  by  the  equipment  or 
the  simple  reaction  time  of  the  student. 

Fig.  6 contains  PRETEST  TIME  as  a function  of  PASSAGES  MASTERED.  The 
values  plotted  for  each  grade  level  of  difficulty  were  the  end  result  of  the 
same  type  of  averaging  procedure  as  was  explained  in  Study  I.  In  Study  II 
there  were  two  sets  of  passages  at  each  grade  level  and  the  second  set,  Set  8, 
followed  the  first  set,  Set  A.  Notice  that  the  time  required  to  complete 
the  pretest  was  over  2.00  minutes  at  the  beginning  and  decreased  to  about  1.40 
min.  at  the  end  of  the  160  passages  that  were  mastered.  The  Low  Raven  group 
started  out  considerably  slower  than  the  High  Raven  group,  but  took  less 
time  in  most  cases  on  the  Set  B passage. 
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Fig.  6.  Study  II.  PRETEST  TIHE,  fni  n.,  as  a function  of  PASS- 
AGES MASTERED  for  t*ia  Low  and  High  Raven  Srouos. 


Fig.  7 contains  PERCENT  ACCURACY  as  a function  of  PASSAGES  MASTERED.  As 
mentioned  earlier,  the  percent  accuracy  score  is  a score  that  has  been  corrected 
for  guessing;  the  number  of  items  answered  wrong  was  subtracted  from  the  number 
of  items  answered  right  and  the  result  was  divided  by  the  total  number  of  items 
and  multipled  by  100.  For  both  the  High  Raven  group  and  the  Low  Raven  group, 
the  scores  tend  to  decrease  as  the  level  of  difficulty  of  the  passages  increases 
from  grade  2 to  grade  9.  In  general,  there  was  little  difference  between  the 
Low  Raven  group  and  the  High  Raven  group.  Toward  the  end  of  the  Set  B passages 
the  Low  Raven  group  seemed  to  score  about  5 to  10  percent  higher  than  the  High 
Raven  group. 

Fig.  8 contains  the  average  number  of  trials  to  reach  mastery,  TRIALS  TO 
MASTERY,  as  a function  of  PASSAGES  MASTERED.  The  pretest  was  counted  as  the 
first  trial  so  if  the  students  had  all  reached  mastery  on  the  pretest,  the 
average  number  of  trials  to  mastery  would  have  been  its  lowest  possible  value, 
1.0.  The  number  of  trials  to  mastery  tended  to  increase  as  the  difficulty  of 
the  passages  increased  from  grade  2 to  grade  9.  There  appeared  to  be  no  con- 
sistent difference  between  the  High  Raven  group  and  the  Low  Raven  group.  The 
Set  B passages  tended  to  be  mastered  faster  than  the  Set  A passages,  thus  re- 
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fleeting  a learning  effect.  On  the  Set  B Passages,  about  1?  trials  were  re- 
quired on  the  grade  2 and  3 passages  and  about  3 trials  were  required  on  the 
grade  7-9  passages.  These  data,  taken  with  the  percent  accuracy  data  pre- 
sented in  Fig.  7,  suggest  that  the  difficulty  of  the  t*aining  material  was 
in  fact  being  manipulated  by  these  passages  which  were  originally  designated 
as  grade  2 to  grade  9 by  the  Rauding  Scale. 

Fig.  9 contains  TOTAL  TIME  as  a function  of  PASSAGES  MASTERED.  Notice  that 
the  Low  Raven  group  tended  to  take  more  time  than  the  High  Raven  group.  However, 
the  difference  between  the  two  groups  at  the  end  of  the  Set  A passages  did  not 
i change  all  through  the  Set  B passages.  This  means  that  the  rate  at  which  both 

groups  worked  on  the  Set  B passages  was  exactly  the  same.  Thus,  the  rate  of 
learning  difference  in  favor  of  the  High  Raven  group  evaporated  after  the  Set 
A passages  had  been  mastered. 

Fig.  10  contains  the  POSTTEST  HIGHER  RGR  as  a function  of  PASSAGES  MASTERED. 

■ Both  groups  have  higher  scores  as  the  number  of  passages  mastered  increases, 

starting  with  an  RGR  around  225  for  the  initial  grade  2 passages  and  increasing 
to  around  325  for  the  final  grade  9 passages.  There  was  no  consistent  differ- 
ence between  the  two  groups  until  the  Set  B passages  was  reached  where  the  Low 
Raven  group  tended  to  score  higher  than  the  High  Raven  group.  Since  these  test 
data  reflect  performance  after  100%  mastery  has  been  achieved,  increases  in  RGR 
is  largely  a result  of  decreases  in  the  time  required  to  complete  the  passage. 

Thus,  these  data  reflect  approximately  the  same  trend  as  the  data  from  the  practice 
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passage  presented  in  Fig.  5.  The  major  difference  is  that  those  data  do  not 
reach  the  high  values  that  approach  400,  partly  because  each  passage  is  only 
mastered  once  in  Fig.  10  whereas  the  same  passage  was  mastered  28  times  in 
Fig.  5. 

Fig.  11  and  Fig.  12  contain  the  primary  data  from  Study  II.  These  data 
parallel  those  data  presented  in  Fig.  3 and  Fig.  4 for  Study  I,  except  the 
students  in  Study  I did  not  complete  the  Set  B passages.  The  research  hypothesis 
was  that  there  would  be  little  or  no  difference  between  the  Low  Ravens  and 
the  High  Ravens  when  gain  in  proficiency  was  measured  with  the  number  of  passages, 
mastered  held  constant,  as  in  Fig.  11.  But,  there  would  be  a difference  in  favor 
of  the  High  Raven  group  when  gain  in  proficiency  was  measured  with  the  total 
amount  of  time  spent  learning  held  constant,  as  in  Fig.  12.  This  hypothesis 
received  no  support  from  these  data  since  the  Low  Raven  group  scored  higher  in 
both  Fig.  11  and  Fig.  12.  In  spite  of  the  fact  that  the  Low  Ravens  and  the 
High  Ravens  started  out  approximately  equal,  RGR  equal  to  about  195,  the  Low 
Ravens  gained  to  an  RGR  around  230  after  around  900-1100  minutes  of  effort  while 
the  High  Ravens  had  only  gained  to  around  205  after  the  same  amount  of  time. 

In  order  to  determine  if  this  lack  of  support  for  the  research  hy- 
pothesis held  for  another  indicant  of  proficiency,  the  POSTTEST  HIGHER  RGR 
values  were  also  plotted  as  a function  of  the  total  amount  of  time  spent 
working  on  the  passages.  Fig.  13  contains  these  data.  Thus,  the  data  in  Fig. 

10  and  Fig.  13  contain  data  which  are  parallel  to  the  data  in  Fig.  11  and  Fig. 

12  except  the  indicant  of  proficiency  is  POSTTEST  HIGHER  RGR  instead  of  PRETEST 
RGR.  THE  POSTTEST  HIGHER  RGR  data  in  Fig.  10  and  Fig.  13  also  do  not  support 
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the  research  hypothesis.  These  data  indicate  little  or  no  difference  between 
the  RGR  scores  of  the  Low  and  High  Raven  groups  for  either  the  passages  mas- 
tered or  total  time  variables. 

Even  though  there  were  no  consistent  differences  between  the  Low  and  High 
Raven  groups,  there  were  large  differences  within  the  Low  Raven  group.  The 
fastest  and  slowest  learners  of  a 1 I 6 students  were  both  in  this  Low  Raven 
group.  This  was  true  for  PRETEST  RGR,  POSTTEST  HIGHER  RGR,  and  also  for  the 
POSTTEST  HIGHER  RGR  on  the  practice  passage.  Fig.  14  contains  the  POSTTEST 
HIGHER  RGR  data  for  the  practice  passage  presented  for  each  session.  Although 
Sf*  (student  4)  started  about  55  words  per  minute  higher  than  Ji6,  £4  was  over 
195  words  per  min.  higher  than  ^6  by  Session  28.  Also  included  in  Fig.  14 
are  the  data  from  2 research  assistants,  graduate  students,  who  worked  on  the 
project.  These  two  graduate  students  followed  exactly  the  same  procedures  as 
the  other  6 students  except  they  completed  the  Set  B passages  before  the  Set 
A passages  and  there  was  an  interuption  of  over  one  month  between  the  com- 
pletion of  the  Set  B passages  and  the  starting  of  the  Set  A passages. 

Notice  that  the  two  graduate  students,  _S7  and  ^8,  completed  all  1 60 
passages  in  only  4-5  sessions  whereas  the  other  6 students  required  around 
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25-30  sessions.  These  two  students  had  achieved  a performance  level  by  the 
fourth  session  that  was  higher  than  5 of  the  other  six  students  had  reached 
in  25  sessions. 

The  rate  of  gain  per  session  for  the  two  graduate  students  was  much 
higher  than  the  other  six  students  even  including  JS1  , the  fastest  of  the  other 
six.  Although  the  rate  of  gain  per  session  varied  considerably  among  the 
8 students,  the  rate  of  gain  per  passage  mastered  was  relatively  constant 
across  the  8 students;  these  data  are  presented  in  Fig.  15.  (Remember  that 
the  two  graduate  students  actually  worked  on  the  Set  B passages  prior  to  the 
Set  A passages.)  It  can  be  seen  that  all  8 curves  are  approximately  par- 
allel indicating  that  the  rate  of  gain  per  passage  mastered  is  approximately 
constant  accross  all  eight  students.  This  type  of  result  was  what  had  been 
hypothesized  for  the  PRETEST  RGR  data  from  the  Low  and  High  Raven  groups. 

These  data  in  Fig.  15  indicate  that  no  matter  what  the  level  of  ability,  as 
indicated  by  the  Raven,  everyone  tends  to  gain  the  same  amount  when  the  amount 
of  quality  practice  is  held  constant.  However,  the  data  in  the  earlier  figure, 
Fig.  14,  indicates  that  the  Raven  was  not  a good  predictor  of  the  differences 
in  gain  per  equal  amounts  of  time  spent  learning.  This  is  because  time  is 
constant  in  Fig.  14  and  one  of  the  students  in  the  Low  Raven  group  turned 
out  to  be  by  far  the  fastest  learner  of  the  six  high  school  students. 
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RAVEN  RESULTS  AND  DISCUSSION 

I n t roduc  t i on . The  results  from  the  three  students  in  the  High  Raven  group 
tended  to  be  approx ima te I y the  same  in  Fig.  14,  but  the  data  from  three  students 
in  the  Low  Raven  group  was  very  disparate.  One  of  these  three  Low  Raven 
students  was  a very  fast  learner,  ^4,  while  another  one  was  approximately  equal 
to  the  High  Ravens,  j>5  , and  one  was  very  slow,  S6.  It  seemed  possible  that 
the  theory  might  be  valid,  in  spite  of  the  data  presented,  if  the  Raven  data 
was  somehow  inaccurate  or  unreliable.  Suppose  ^4  and  ^5  happened  to  belong 
in  the  High  Raven  group  but  tested  out  to  be  in  the  Low  Raven  group  simply 
because  they  failed  to  do  their  best  on  the  test.  This  section  will  contain 
evidence  relevant  to  that  possibility.  Since  there  was  such  a lack  of  homogeneity 
in  the  Low  Raven  group,  the  results  from  each  student  will  be  presented. 

Wechsler  Data.  Table  1 contains  the  data  from  the  WISC.  The  median  Verbal 
IQ  of  the  High  Raven  group  is  79  and  the  median  for  the  Low  Raven  group  is  76. 

The  lowest  Verbal  IQ  was  for  S(> , the  slowest  learner  as  discussed  earlier.  For 
the  Performance  IQ's,  the  median  of  the  High  Raven  group  was  104  and  the  median 
of  the  Low  Raven  group  was  79.  These  data  seem  to  rep  I icate  the  reading  test 
data  and  the  Raven  data  used  to  select  these  students.  The  reading  test  data 
is  in  parallel  with  the  Verbal  IQ  data  and  the  Raven  test  data  is  in  parallel 
with  the  Performance  IQ  data.  The  Raven  grade  levels  were  used  to  select  students 
who  seemed  to  have  high  potential  for  learning  to  read  better.  The  three  High 
Raven  students  had  a median  Performance  IQ,  104,  which  is  considerably  higher 
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than  their  median  Verbal  IQ,  79.  which  also  would  suggest  high  potential  for 
this  group.  The  Low  Raven  group  was  selected  because  their  Raven  grade  levels 
suggested  low  potential  with  respect  to  learning  to  read  better.  These  three 
students  have  a median  Performance  IQ,  79.  which  is  connensurate  with  their 
median  Verbal  IQ,  76,  indicating  little  potential  from  a verbal  standpoint. 
Thus,  the  WISC  tends  to  reinforce  the  reliability  and  validity  of  the  Raven 
rather  than  suggesting  that  it  was  inaccurate. 


Raven  Data.  The  hypothesis  about  the  inaccuracy  of  the  Raven  was  investi- 
gated further  in  spite  of  the  WISC  data  which  supported  its  reliability  and 
validity.  The  reason  the  fast  learners  in  the  Low  Raven  group  scored  low  on 
the  Raven  may  have  been  because  they  did  not  try  their  best  or  because  they 
were  impulsive.  A small  subsiderary  data  collection  effort  was  initiated  to- 
ward the  end  of  Study  II  to  investigate  these  possibilities.  The  Raven  was 
administered  again,  individually,  under  quite  different  conditions.  The 
student  orally  stated  the  answer  to  each  item  and  was  immediately  given  a dime, 
10c,  if  the  answer  was  correct.  If  the  student  was  wrong,  the  student  was 
asked  to  try  again.  To  reduce  impulsivity,  the  student  was  asked  to  wait  one 
min.,  as  indicated  by  a stop  watch  that  the  student  could  see,  before  giving 
the  second  answer.  The  two  scores  which  resulted  as  well  as  the  scores  from 
the  two  earlier  testings,  are  p esented  in  Table  2.  For  ease  of  interpretation, 
the  grade  equivalent  scores  for  each  individual  have  been  presented  and  they 
have  been  rounded  off  to  the  nearest  grade  level. 
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Notice  in  Table  2 that  the  fastest  learner,  S4 , still  made  a low  Raven 
score,  5,  even  when  paid  1 Oc  for  each  correct  answer  on  the  third  administration 
of  the  test.  Thus,  lack  of  motivation  did  not  seem  to  be  a good  hypothesis  for 
explaining  the  low  Raven  score.  However,  when  the  second  try  results,  i.e., 
the  fourth  administration  of  the  test,  were  scored  as  though  they  were  simply 
another  Raven  Test,  it  can  be  seen  that  Sk  greatly  improved  his  score  (to  9) 
almost  to  a point  where  it  equalled  the  scores  in  the  High  Raven  group  (10,10, 

6-  11).  ^6  also  considerably  improved  his  score  as  a result  of  the  fourth 

testing  session.  S5 , however,  scored  closer  to  ^6  on  the  Raven  while  being  closer 
to  S4  and  the  High  Raven  group  in  terms  of  rate  of  learning. 

These  data  are  mixed  with  respect  to  explaining  the  lack  of  support  for 
the  research  hypothesis.  It  seems  reasonable  that  the  potential  of  ^4,  the 
fastest  learner,  was  not  accurately  measured  by  the  Raven  because  of  his 
impulsivity.  It  could  easily  be  that  this  student  has  an  extremely  poor 
strateay  for  tackling  these  problems.  It  seems  reasonable  that  this  student 
would  do  much  better  on  the  Raven  than  the  other  Ss  i f he  could  be  trained  to 
take  his  time,  and  sys temt i ca I ly  eliminate  all  wrong  alternatives  before  choosing 
his  answer.  Similarly,  it  would  seem  that  this  student  would  have  done  much 
better  on  the  WISC  performance  scale  if  he  was  trained  to  take  his  time  and 
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TABLE  1 


Verbal  and  Performance 

IQ.  Scores 

from  the  W 1 SC 

for  the  6 Students 

Group 

S tudent 

Verba  1 

Performance 

1 

74 

118 

High  Raven 

2 

79 

104 

CO 

vn 

96 

Med  ian 

79 

104 

4 

76 

CO 

v-n 

Low  Raven 

5 

81 

79 

6 

_56_ 

76 

Med  ian 

76 

79 

TABLE  2 

Raven  Scores  In  Grade  Equivalents 
for  the  6 Students  in  Study  II 
TEST  ADMINISTRATION 


S 

First 

Second 

Th  i rd 

Fourth 

1 

5 

8 

9 

1 1 

2 

6 

8 

8 

10 

3 

9 

9 

9 

10 

4 

5 

3 

5 

9 

5 

4 

5 

6 

7 

6 

2 

3 

3 

6 

do  his  dest.  However,  as  satisfying  as  this  explanation  for  S4  may  be,  the 
data  of  ^5  still  was  inconsistent.  did  not  make  much  progress  even  with 
the  repeated  testing.  ^5  was  as  fast  a learner  as  the  £s  in  the  High  Raven 
group  yet  had  a Raven  score  that  was  closer  to  S6 , the  slowest  learner. 

There  is  one  additional  piece  of  confounding  information  that  needs  to 
be  reported.  S4  and  ^5  turned  out  to  have  been  school  friends  prior  to  the 
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experiment.  They  participated  on  different  days  but  kept  track  of  each  other's 
progress  in  order  to  compete  with  each  other.  For  example,  _S4  sometimes  did 
I not  take  the  10  min.  break  that  was  allowed  at  the  end  of  the  first  hour  so  that 

he  could  work  to  get  ahead  of  £5.  Thus,  variation  in  the  motivation  variable 
during  training  may  have  confounded  the  results. 
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STUDY  I I I 


INTRODUCTION 


The  data  and  results  from  Study  II  had  implications  for  the  design  and 
data  collection  in  Study  III. 

It  was  decided  that  the  focus  in  Study  III  should  rema i n upon  comparing 
High  Ravens  with  Low  Ravens  to  see  if  the  lack  of  support  for  the  original  re- 
search hypothesis  could  be  replicated  a third  time.  It  was  noted  in  an  analy- 
sis of  the  individual  data  in  Study  II  (not  presented  earlier)  that  the  student 
who  gained  as  much  or  more  than  anyone  on  PRETEST  RGR  was  the  student  with 
the  lowest  WISC  Verbal  and  Performance  scores.  Therefore,  it  seemed  reason- 
able to  attempt  to  select  the  next  set  of  6 students  with  slightly  lower  reading 
ability  at  the  outset.  The  training  procedure  may  result  in  gains  that  are 
task  specific  for  the  betters  readers  but  are  more  likely  to  be  gene ra I i zable 
to  normal  reading  for  the  readers  at  a slightly  lower  level  of  reading  ability. 

METHOD 


Selection  of  Subjects.  Of  the  28  students  in  Study  II  who  came  for  the  2 
hr.  testing  session  that  was  part  of  the  selection  procedures,  9 of  that  group 
was  invited  to  come  again  for  another  2-hr.  testing  session.  These  nine  students 
had  reading  test  scores  which  were  just  lower  than  the  6 students  who  were 
selected  for  Study  II.  The  lowest  reading  ability  score  of  the  6 Study  II  sub- 
jects, initially,  was  grade  4,  and  the  reading  ability  scores  of  the  individuals 
in  this  Study  III  group  were  grade  4 or  grade  3. 

From  this  group  of  9 which  was  invited  to  particpate  and  told  they  would 
be  paid  $5.00  for  their  participation,  7 actually  came  for  the  testing. 

At  this  second  pretesting  session.  Form  B of  the  NRS  was  administered, 
both  Level  1 and  Level  2.  Then  the  Raven  was  administered  again.  The  j>s  were 
reminded  that  they  had  taken  the  Raven  twice  before,  back  in  September.  They 
were  told  that  the  items  on  answer  sheets  that  they  missed  the  second  time 
they  took  the  test  had  been  marked  with  an  X.  They  were  asked  to  take  the  test 
again,  trying  to  make  sure  they  got  the  same  items  right  again  and  trying  harder 
on  the  ones  they  missed  before. 

Six  of  the  seven  were  selected  to  participate  in  Study  I I I — five  girls 
and  one  boy.  Using  the  student's  highest  score  on  any  of  the  forms  of  the 
NRS  that  were  administered,  these  six  Ss  this  time  all  scored  between  grade  4 
and  grade  6.  The  three  students  choosen  for  the  High  Raven  group  scored  at 
grade  9 and  grade  10  on  this  third  administration  of  the  Raven.  The  three 
students  choosen  for  the  Low  Raven  group  scored  at  grade  6 or  grade  7. 

Procedures . The  training  procedures  were  exactly  the  same  as  reported 
i n S tudy  I I . 

Data  Analyses.  The  data  analysis  procedures  were  also  exactly  the  same 
as  reported  in  Study  II. 

GROUP  RESULTS  AND  DISCUSSION 

In  Fig.  16,  the  POSTTEST  HIGHER  RGR  values  on  the  initial  practice  pass- 
a ge  for  each  session  have  been  presented  for  the  Low  and  High  Raven  groups.  All 
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students  in  each  group  finished  at  least  25  sessions.  These  data  replicate  the 
results  of  Study  II  (presented  in  Fig.  5)  in  that  there  was  little  difference 
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between  the  two  groups  and  what  difference  there  was  tended  to  favor  the  Low 
Raven  group.  These  students  in  Study  III  started  slightly  lower  in  session 
1 than  the  Study  II  students  and  were  also  slightly  lower  at  Session  25. 

Fig.  17  contains  PRETEST  TIME  as  a function  of  PASSAGES  MASTERED.  These 
data  tend  to  parallel  those  in  Study  II  (see  Fig.  6)  except  the  Low  Raven  group 
performed  consistently  faster  than  the  High  Raven  group  from  the  first  to  the 
last  of  the  160  passages. 

Fig.  18  contains  PERCENT  ACCURACY  as  a function  of  PASSAGES  MASTERED.  As 
was  the  case  in  Study  II  (see  Fig.  7)  there  seemed  to  be  no  important  difference 
between  the  Low  and  High  Raven  groups. 

Fig.  19  contains  TRIALS  TO  MASTERY  as  a function  of  PASSAGES  MASTERED. 

As  noted  earlier  the  first  test  was  counted  as  a trial  so  the  smallest  possible 
value  for  the  TRIALS  TO  MASTERY  variable  was  1.  In  general  these  data  replicate 
the  data  for  Study  II  (see  Fig.  8)  except  the  Low  Raven  group  in  Study  III  tend- 
ed to  require  more  trials  to  reach  mastery.  It  may  be  remembered  that  the  Low 
Raven  group  tended  to  go  faster  on  the  first  trial  (from  Fig.  17)  and  this  may 
account  for  why  they  required  more  trials  on  the  average  than  the  High  Raven 
group. 

Fig.  20  contains  TOTAL  TIME  as  a function  of  PASSAGES  MASTERED.  The  data 
from  the  Low  Raven  group  is  a almost  perfectly  coincident  with  the  data  from  the 
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High  Raven  group.  These  two  groups  required  about  1265  min.  (21.1  hrs.),  on 
the  average,  to  finish  all  160  passages.  Compared  to  the  two  groups  in  Study 
II,  one  group  of  those  two  required  8%  less  time  and  the  other  group  required 
16%  less  time  than  the  Study  III  groups.  The  data  in  Fig.  20  indicate  again 
that  the  Low  Raven  group  tended  to  master  the  passages  at  the  same  .ate  as 
the  High  Raven  group. 

Fig.  21  contains  POSTTEST  HIGHER  RGR  as  a function  of  PASSAGES  MASTERED. 
Again,  these  data  tend  to  replicate  the  corresponding  data  in  Study  II  (see  F 
10).  There  was  little  or  no  difference  between  the  Low  and  High  Raven  groups 
Again,  these  two  groups  in  Study  III  tend  to  start  and  finish  slightly  lower 
than  the  two  groups  in  Study  II. 
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Fig.  22  and  Fig.  23  contain  the  primary  data  from  Study  III.  These  data 
replicate  the  results  of  Study  I and  Study  II.  To  reiterate,  the  research 
hypothesis  was  that  there  would  be  little  or  no  difference  between  the  Low 
Ravens  and  the  High  Ravens  when  gain  in  proficiency  was  measured  with  the  num- 
ber of  passages  held  constant,  as  in  Fig.  22,  but  there  would  be  a difference 
in  favor  of  the  High  Raven  group  when  gain  in  proficiency  was  measured  with 
total  time  held  constant,  as  in  Fig.  23.  The  research  hypothesis  again  received 
no  support.  There  was  very  little  difference  between  the  two  groups  in  Fig.  22 
or  Fig.  23  but  what  difference  there  was  tended  to  favor  the  Low  Raven  group 
as  was  also  the  case  in  Study  II. 

As  was  the  case  in  Study  II,  the  data  in  Fig.  24  will  be  presented  to 
determine  whether  the  lack  of  support  for  the  research  hypothesis  also  held  for 
another  indicant  of  proficiency,  POSTTEST  HIGHER,  RGR.  The  data  in  Fig.  21  and 
Fig.  24  contain  data  which  are  parallel  to  the  data  in  Fig.  22  and  Fig.  23 
except  the  indicant  of  proficiency  is  POSTTEST  HIGHER  RGR  instead  of  PRETEST 
RGR.  The  POSTTEST  HIGHER  RGR  Data  in  Fig.  21  and  Fig.  24  also  do  not  support 
the  research  hypothesis.  The  data  in  Fig.  24  tend  to  replicate  the  correspond- 
ing results  in  Study  II  (see  Fig.  13)  and  do  not  indicate  superiority  for  the 
High  Raven  Group;  instead  the  data  again  indicated  a slight  superiority  for 
the  Low  Raven  group. 

As  was  also  done  in  Study  II,  the  individual  POSTTEST  nIGHER  RGR  data  has 
been  presented  for  the  practice  passage  that  was  administered  at  the  beginning 
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of  each  training  session.  Fig.  25  contains  these  data  for  each  session.  The 

largest  difference  between  two  individuals  is  for  S2  and  S6.  Also  included  in 

Fig.  25  are  the  data  for  another  two  graduate  students,  different  from  the 

two  in  Study  II.  These  latter  two  students  followed  the  same  procedures  as 

did  the  corresponding  two  graduate  students  described  in  Study  II.  Again, 

these  two  graduate  students  gained  much  more  in  a shorter  period  of  time  than 

the  6 high  school  students.  The  drastic  differences  in  gain  (note  the  slopes 

of  the  curves)  between  individuals,  with  respect  to  gain  in  POSTTEST  HIGHER  RGR,  tend 

to  disappear  again,  however,  when  they  are  related  to  PASSAGES  MASTERED — presented 

in  Fig.  26.  These  da ta  replicate  the  data  in  Study  II  (see  Fig.  14  and  Fig.  15). 

The  cains  of  the  fastest  graduate  student  in  Fig.  26  are  approximately  equal 
to  the  gains  of  the  high  school  students.  Again,  this  was  the  type  of  result 
expected  but  not  obtained  for  the  PRETEST  RGR  data  when  comparing  the  Low  and 
High  Raven  groups.  It  was  expected  that:  (a)  the  gains  would  be  different 

under  equal  time  conditions  but  the  same  for  equal  mastery  conditions,  and 
(b)  that  the  fastest  gainers  under  the  equal  time  conditions  would  be  the  students 
in  the  High  Raven  group. 
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RAVEN  RESULTS  AND  DISCUSSION 

As  was  the  case  in  Study  II,  the  Raven  was  again  adm  i n i s tered  toward  the 
end  of  Study  III  using  the  same  procedures  as  were  used  in  Study  II.  To 
reiterate,  the  students  were  paid  1 0<  as  soon  as  they  answered  an  item  correctly. 
If  they  answered  the  item  incorrectly,  they  were  forced  to  wait  one  min.  be- 
fore giving  their  second  answer;  they  were  paid  5c  if  they  answered  the  item 
correctly  the  second  time. 

These  Study  III  students  had  taken  the  Raven  twice  in  September  along 
with  the  Study  II  students.  Then,  they  took  it  again  in  December.  Finally, 
they  took  it  again  in  April  under  the  pay  conditions.  Thus,  they  received 
five  different  scores  on  the  Raven.  The  first  score  was  a regular  Raven  score. 
The  second  score  came  from  the  second  administration  of  the  test  where  they 
knew  which  items  they  answered  wrong  the  first  time;  but  they  did  not  know 
which  alternative  they  chose  or  which  alternative  was  the  wrong  one.  The  third 
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score  came  from  the  third  administration  where  they  knew  which  items  (but  not 
which  alternative)  they  answered  wrong  the  second  time.  The  fourth  score  came 
from  the  fourth  admi n i s tra t ion  where  they  were  given  no  feedback  from  previous 
administrations  but  they  were  paid  10c  for  each  correct  answer.  The  fifth  score 
also  came  from  the  fourth  administration  but  an  incorrect  item  was  changed  to 
a correct  item  for  the  fifth  score  as  long  as  the  item  was  answered  correctly 
the  second  time.  The  results  for  each  individual  on  each  scoring  are  presented 
in  Table  3.  The  scores  are  grade  level  equ i va 1 ents  ,as  described  earlier. 

The  6 students  were  selected  after  the  second  scoring  when  the  High  Ravens 
(SI,  S2  and  S3)  ranged  from  7 to  9 and  the  Low  Ravens  (S4,  S5 , and  S6)  ranged 
from  4 to  6.  After  the  fifth  scoring,  it  may  be  noted  that  the  High  Ravens 
ranged  from  11  to  1 2 and  the  Low  Ravens  ranged  from  9 to  12.  The  difference 
between  the  means  of  the  High  and  Low  Raven  groups  on  the  second  scoring  was  3.6; 
by  the  fifth  scoring  this  difference  was  only  1.0.  Thus,  after  motivation 
supposedly  had  been  maximized  and  after  impu I s i v i t i ty  supposedly  had  been  minimized, 
then  the  differences  between  the  two  groups  became  much  smaller,  being  of  the 
order  of  only  one  grade  level  difference. 
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Table  3 

Raven  Scores  in  Grade  Equivalents 
for  the  6 students  in  Study  III 
Scoring  Occasion 


s 

First 

Second 

Third 

Fourth 

Fifth 

1 

6 

7- 

10 

9 

1 1 

2 

9 

9 

10 

1 ? 

12 

3 

5 

9 

9 

9 

1 1 

4 

2 

6 

7 

10 

12 

5 

5 

4 

6 

8 

10 

6 

3 

4 

6 

7 

9 
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TRAINING  EFFECTIVENESS 


INTRODUCTION 


The  primary  purpose  of  the  research  reported  under  Studies  I,  II,  and  III, 
was  to  compare  the  gain  in  reading  ability  of  the  Low  Ravens  with  the  High 
Ravens.  Thus,  the  research  design  focused  upon  this  comparison.  A secondary 
concern,  however,  was  the  effectiveness  of  the  training  procedure  itself  as 
a method  for  improving  reading  ability.  If  the  training  procedures  did  not  in 
fact  increase  reading  ability,  this  would  have  a crucial  effect  upon  the  inter- 
pretation of  the  research  results.  This  section  will  focus  upon  the  supplementary 
data  that  was  collected  relevant  to  the  effectiveness  of  the  training  technique 
as  a facilitator  of  gain  in  general  reading  ability. 

The  data  from  'the  practice  passage  in  Studies  II  and  III  leave  no  doubt 
but  that  the  individuals  in  fact  learn  to  read  that  passage  more  efficiently. 
However,  this  type  of  task  is  far  removed  from  ordinary  reading  since  it  in- 
volves primarily  increasing  the  speed  at  which  the  correct  word  in  a sentence 
can  be  recognized  when  the  sentence  is  part  of  a passage  that  has  been  read  so 
many  times  that  it  is  probably  almost  memorized.  Compared  to  the  POSTTEST 
HIGHER  RGR  data  for  the  practice  passage,  the  POSTTEST  HIGHER  RGR  data  for  the 
160  passages  is  closer  to  ordinary  reading.  Each  passage  is  not  mastered  more 
than  once,  as  was  the  case  for  the  practice  passage.  Yet,  this  task  is  also 
far  removed  from  ordinary  reading.  It  involves  the  repeated  reading  of  the  same 
passage  until  all  items  are  answered  correctly,  i.e.,  the  passage  is  mastered. 
Thus,  just  because  there  is  gain  on  this  variable,  there  is  little  cause  to 
infer  that  this  reflects  gain  in  general  reading  ability.  The  best  data  as 
discussed  earlier,  for  inferring  gain  in  general  reading  ability  comes  from 
the  first  trial  RGR  variable,  i.e.,  the  PRETEST  RGR  data.  These  data  reflect 
how  well  the  student  reads  a passage  that  the  student  has  never  seen,  read, 
or  heard  before.  This  task  is  much  more  similar  to  what  happens  during 
ordinary  reading.  Thus,  these  data,  from  Study  II,  were  analyzed  in  more  detail. 

Another  way  used  to  evaluate  the  effectiveness  of  the  training  upon  general 
reading  ability,  was  to  administer  standardized  achievement  tests.  This  was  an 
evaluation  of  the  degree  to  which  the  gain  in  skill  on  the  computer  administered 
reading  tasks  transfered  to  other  reading  situations. 

The  results  from  the  aforement ioned  Study  II  data  and  transfer  data  will 
be  presented  in  the  two  subsequent  sections. 

STUDY  I I DATA 

The  PRETEST  RGR  data  for  each  of  the  subjects  in  Study  II  are  presented  in 
Fig.  27.  These  data  were  obtained  by  calculating:  (a)  the  mean  of  the  two 

medians  at  each  grade  level  for  each  group  of  5 passages  (this  step  was  the  same 
initial  step  as  was  described  earlier  when  the  Low  and  High  Raven  analyses  were 
described),  and  (b)  the  mean  of  the  grade  2 and  3 means  was  calculated  (called 

Block  2.5),  the  mean  of  the  grade  4,  5.  and  6 means  was  calculated  (called  Block 

5.0)  and  finally  the  mean  of  the  grade  7.  8,  and  9 means  was  calculated  (called 
Block  8.0).  This  procedure  was  followed  for  both  the  Set  A and  Set  B passages 
for  each  student. 

It  may  be  noted  in  Fig.  27  that  for  each  8lock,  indicating  equal  passage 

difficulty,  each  person  showed  a gain  between  the  Set  A and  Set  B passage.  These 

data  suggest  that  each  of  these  six  students  gained  in  their  ability  to  read  the 
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Fig.  27.  Study  I I . For 
blocks  of  the  Set  A and  Set  3 
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sentences  in  the  passages. 

The  gains  in  Fig.  27  may  have  been  caused  by  the  reading  practice  training. 

But  they  could  also  be  trivial  gains.  Furthermore,  there  could  be  several  alterna- 
tive hypotheses  that  could  just  as  easily  explain  these  data.  The  first  alternative 
hypothesis  is  that  the  gain  in  skill  was  specific  to  the  task  or  the  computer 
equipment  used  in  the  research.  Evidence  relevant  to  this  hypothesis  and  re- 
levant to  whether  the  gain  is  trivial  or  not  comes  from  the  NRS  test.  This  test 
was  administered  prior  to  the  training,  as  described  earlier,  and  also  subsequent 
to  the  training,  i.e.,  at  the  end  of  the  training  sessions.  Table  4 contains  the 
median  grade  equivalent  scores  for  thepreand  post  administrations  of  the  NRS  test, 
together  with  the  gain  scores.  The  gain  for  the  6 students  was  3.6  grade  equivalents, 

Table  4 

Pretest  to  Posttest  Gains  in  Study  II 


Pretes  t 

Posttes  t 

Ga  i n 

NRS  Test  (Grade  Equivalents) 

4.5 

8.1 

3.6 

NRS  Test  (Estimated  Reading  Rate 
i n words  per  min.) 

175.5 

205.5 

30.0 

PRETEST  RGR  (set  A,  Block  2.5 
for  Pre  and  Set  B,  Grade 
Block  8.0  for  Post  ) 

201  .5 

216.5 

15.0 

PRETEST  RGR  (Median  of  first 
5 passages  for  Pre  and  Median 
of  last  5 passages  for  Post) 

195.0 

215.5 

20.5 

starting  with  4.5  on  the  pretest  and  going  to  8.1  on  the  posttest.  Part  of  this 
gain  is  no  doubt  due  to  repeated  administrations  of  the  test.  Part  of  the  gain 
also  could  be  due  to  regression  effects  but  this  is  not  likely  since  the  NRS  test 
is  a sequential  type  of  test  where  extremely  high  or  extremely  low  scores  indic- 
ate a higher  or  lower  forms  of  the  test  should  be  given.  The  6 subjects  made 
extremely  low  scores  on  the  NRS  3A  test  and  were  subsequently  administered  the 
NRS  2A  test.  They  made  neither  extremely  high  or  extremely  low  scores  on  this 
test.  Therefore,  regression  to  the  mean  should  not  be  a major  factor  contri- 
buting to  this  gain.  Since  there  were  not  enough  students  who  made  equal  read- 
ing scores  and  still  differed  widely  on  the  Raven  to  form  a control  group,  it 
is  difficult  to  assess  the  amount  of  gain  due  to  repeated  testing. 

There  is  a replicative  type  of  evidence  for  the  size  of  the  gain  as  in- 
dicated by  the  NRS  test.  Using  the  manual  for  the  test,  the  NRS  grade  equivalent 
scores  can  be  converted  into  rate  of  reading  scores  in  words  per  min.  This  rate 
is  supposed  to  be  the  rate  at  which  an  individual  would  ordinarily  read  a pass- 
age that  was  relatively  easy  for  the  individual  to  read.  These  data  are  also 
presented  in  Table  4.  Notice  that  the  median  pretest  rate  was  175.5  words 
per  min.  and  the  median  posttest  rate  was  205.5  words  per  min.,  reflecting  an 
absolute  gain  of  30  words  per  min  or  a 17%  gain.  The  above  gain  can  also  be 
compared  to  the  gain  in  the  RGR  variable,  discussed  earlier.  The  equation  for 
calculating  the  RGR,  Equation  1,  was  developed  using  the  same  formulas  as  was 
the  NRS  rate  of  reading  scores  mentioned  above.  Therefore,  the  RGR  scores  should 
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be  comparable  to  these  rate  of  reading  scores.  The  only  major  difference 
is  that  the  NRS  test  requires  that  a pencil  be  used  to  mark  the  box  in  front  of 
the  correct  items  while  the  computer  task  from  whence  the  RGR  scores  came,  re- 
quires a key  on  the  left  or  on  the  right  to  be  depressed  to  indicate  choices. 

The  mean  of  the  PRETEST  RGR  scores  on  Block  2.5  for  Set.  A,  in  Fig.  27,  may 
be  used  as  an  indicator  of  pre  training  ability  and  the  mean  of  the  Block  8.0 
for  Set  B in  Fig.  27  may  be  used  as  an  indicator  of  post  training  ability.  The 
medians  of  these  individual  means  are  also  presented  in  Table  3.  The  pre-training 
median  was  201.5  words  per  min  and  the  posttraining  median  was  216.5  wpm  for  a 
gain  of  15  wpm  or  a gain.  Th i s 1 5 wpm  gain  is  not  far  from  the  30  wpm  gain 
on  the  NRS.  Another  way  of  analyzing  these  same  data  would  be  to  let  the  median 
RGR  of  the  first  5 passages  reflect  pretraining  ability  and  the  median  RGR  of 
the  last  5 passages  reflect  post  training  ability.  This  analysis  is  closer  to 
the  beginning  and  the  end  of  training,  and  may  reflect  the  gain  better.  These 
data  are  also  included  in  Table  4.  The  median  of  these  6 pretraining  indicators 
was  195.0  wpm  and  the  median  of  the  post  training  indicators  was  215.5  wpm  giving 
a gain  of  20.5  wpm  for  a 11%  gain.  These  gain  data  are  close  to  the  NRS  data, 
i.e.,  the  30  wpm  or  17%  gain.  r 

The  gains  using  the  pretest  RGR  data  and  the  gains  using  the  NRS  seem 
to  be  relatively  comparable.  Thus,  it  appears  reasonable  to  suggest  that  this 
reading  skill  training  produced  about  a 10-15%  gain  in  reading  efficiency  for 
these  individuals.  This  increase  may  also  be  interpreted  as  a gain  of  around 
3-4  grade  equivalents  on  a standardized  test.  However,  inferrences  about  the 
size  of  the  gain  should  be  interpreted  cautiously  since  there  was  no  control 
group.  Also,  it  should  be  pointed  out  that  the  PRETEST  RGR  data  from  the  two 
graduate  students  also  showed  gains;  these  data  are  also  presented  in  Fig-.  27. 
Since  these  two  graduate  students  showed  large  gains  on  the  first  trial  RGR 
data  as  a result  of  training,  should  we  also  conclude  that  they  became  better 
readers  as  a result  of  this  brief  training?  Their  gains  were  greater  than  the 
high  school  students.  It  does  not  seem  reasonable  to  expect  that  these  two 
graduate  students  became  better  readers  simply  by  completing  this  reading  train- 
ing practice  on  these  grade  2 through  grade  9 passages.  Their  gain  seems  to  be 
more  reasonably  restr'rted  to  this  task  and  not  transferable  to  their  regular 
reading.  If  this  is  in  fact  the  case,  then  is  it  reasonable  to  expect  the  gains 
of  the  6 high  school  students  to  transfer  to  their  regular  reading?  It  could 
be  that  all  of  the  reading  progress  is  specific  to  this  particular  type  of 
task,  and  does  not  transfer  to  regular  reading. 

In  order  to  further  assess  the  effectiveness  of  the  training  procedure 
another  data  collection  effort,  described  in  the  next  section,  was  initiated. 

TRANSFER  DATA 

I n t roduc t i on . Additional  testing  was  conducted  in  order  to  get  an  in- 
dication of  whether  the  gain  in  reading  performance  experienced  by  the  high 
school  students  was  a gain  in  general  reading  ability  or  not.  Since  the  NRS 
test  provides  a task  that  is  almost  exactly  the  same  as  the  training  task 
itself,  it  is  quite  possible  that  the  gain  in  general  reading  ability  indic- 
ated by  the  NRS  test  is  artifactua).  It  could  be  that  this  gain  is  quite 
specific  to  the  task  and  does  not  transfer  to  ordinary  reading  or  to  other  read- 
ing tasks.  Thus,  the  following  data  collection  effort  was  designed  to  provide 
an  answer  to  this  question  regarding  general  or  specific  gains  in  reading 
ability. 

The  full  set  of  the  Ga tes-MacG i n i t i e Reading  Test  was  administered  to  all 
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of  the  Study  II  and  Study  III  Ss . This  test  has  three  sub tests--Speed  and 
Accuracy,  Vocabu I a ry , and  Comprehens i on--wh i ch  provided  data  relevant  to 
the  general  gains,  or  the  degree  to  which  the  skills  learned  by  the  high  school 
students  transfer  to  Other  reading  situations. 

Data  were  also  collected  relevant  to  reading  rate.  It  could  be  that  t h 
students  became  more  accomplished  readers  only  in  the  sense  of  being  able  to 
read  faster.  That  is,  they  may  not  be  able  to  comprehend  any  more  than  they 
could  prior  to  training  but  they  may  be  able  to  comprehend  the  same  material 
in  less  time.  They  may  have  improved  the  efficiency  with  which  they  transform 
the  words  in  sentences  into  the  complete  thoughts  the  words  represent  (see  Carver, 
1978).  Thus,  it  seemed  important  to  collect  data  regarding  typical,  normal,  or 
ordinary  reading  rate;  a set  of  Reading  Rate  measures  was  developed,  as  described 
later. 

Alternate  forms  of  the  Reading  Rate  measures  and  the  Ga tes-Ma cG i n i t i e tests 
were  administered  during  January  and  April.  For  the  Study  II  Ss , the  January 
testing  took  place  soon  after  they  had  finished  training,  POSTTESTING,  and  the 
April  testing  took  place  long  after  they  had  finished  training,  DELAYED-POSTTEST I NG . 
For  the  Study  III  _Ss , the  January  testing  was  at  the  beginning,  PRETESTING,  and 
the  April  testing  was  at  t.he  end  of  the  training,  POSTTESTING. 

The  data  to  be  presented  in  this  section  provided  better  evidence  relevant 
to  whether  the  gains  reflected  by  the  reading  efficiency  measures  and  the  NRS 
tests  were  replicable  by  other  measures. 

Test  Procedures.  The  six  Study  II  students  were  paid  $6.00  each  to  return 
for  2 hours  of  testing  in  January.  At  the  outset,  four  reading  rate  measures 
were  administered.  Four  100-word  passages,  two  grade  1 and  two  grade  4,  were 
given  to  the  student  to  read.  The  student  was  asked  to  read  the  passage  at  his 
or  her  normal  rate  and  was  told  that  no  test  would  be  given  because  the  experi- 
menter was  only  interested  in  measuring  normal  reading  rate.  The  experimenter 
measured  the  elaspsed  time  to  read  each  passage  using  a stop  watch.  Altogether, 
there  were  4 passages  at  grade  1 difficulty  and  4 at  grade  4 difficulty  (these 
same  passages  were  also  used  in  a previous  experiment,  Carver,  1977b);  dif- 
ficulty level  was  measured  using  the  Rauding  Scale.  Two  of  the  passages  at 
each  grade  were  administered  during  the  subsequent  April  testing.  The  order  of 
administration  of  the  passages  and  the  specific  passages  administered  to  the 
group  were  counterba lanced  over  the  pre  and  post  testing  using  an  incomplete 
La  t i n-squa  re  . 

After  the  reading  rate  measures  had  been  administered,  the  Speed  and 
Accuracy  Subtest,  the  Vocabulary  Subtest,  and  the  Comprehension  Subtest  of 
Survey  0.  Form  1 of  the  Gate's  MacGinitie  Reading  test  were  administered. 

The  *ix  Study  III  students  were  administered  the  same  tests  as  described 
above  for  the  six  Study  II  students.  The  four  reading  rate  measures  and  the 
Speed  and  Accuracy  subtest  and  the  Vocabulary  subtest  of  the  Gates-MacG in i t i e 
were  administered  at  the  beginning  of  Session  3 and  the  Comprehension  Subtest 
of  the  Gates-Mac  Ginitie  was  administered  at  the  beginning  of  Session  4. 

The  same  measures  that  were  administered  during  January  were  also  administered 
again  in  April  using  the  same  procedures.  However,  for  the  April  testing,  Survey 
D.Form  2 of  the  Gates  MacGinitie  was  used,  and  each  student  was  asked  to  read 
four  different  passages  for  the  Reading  Rate  measures,  as  described  earlier. 
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As  described  earlier,  the  NRS  testing,  Form  A, was  administered  in  September 
to  both  the  Study  II  and  Study  III  jjs , The  NRS  Form  B testing  was  administered 
in  December  to  both  groups.  The  NRS  Form  A testing  was  also  administered  again 
during  the  April  Testing. 

An  overview  of  the  testing  and  the  training  schedule  for  both  the  Study  II 
and  Study  III  students  is  presented  in  Table  5.  Since  .he  Study  II  students 
were  given  the  NRS,  the  Reading  Rate  measures,  and  the  Ga tes-MacG i n i t i es  again 
in  April,  long  after  they  had  finished  their  training  in  December,  this  testing 
was  referred  to  as  the  DELAYED- POSTTEST  I NG  for  them.  Since  the  Study  III  students 
were  given  the  NRS  test  in  September  long  before  they  began  training  in  January, 


Table  5 

An  Overview  of  the  Testing  and  Training 
Schedule  for  the  Study  II  and  Study  III  Students 


Mon  th 

Study  1 1 Students 

S tudy  1 1 1 Students 

September 

PRETESTING: 

NRS 

ADVANCED-PRETESTING:  NRS 

October 

(TRA INING) 

Novembe  r 

(TRAINING) 

December 

POSTTESTING: 

NRS 

PRETESTING:  NRS 

Janua  ry 

POSTTESTING: 

Rate,  Gates 

PRETESTING:  Rate,  Gates 

Februa  ry 

(TRAINING) 

Ma  rch 

(TRAINING) 

April 

DELAY ED -POSTTEST  1 NG : 
NRS,  RATE,  GATES 

POSTTESTING: 

NRS,  RATE,  GATES 

this  testing  was  referred  to  as  the  ADVANCED  PRETESTING.  Although  the  NRS  was 
given  in  December  and  the  Rate  and  Gates  measures  were  given  in  January,  they 
seemed  to  be  close  enough  in  time  to  lump  them  together  as  POSTTESTING  for  the 
Study  II  students  and  PRETESTING  for  the  Study  III  students. 

Results  and  Discussion.  Fig.  28  contains  the  results  for  the  NRS  test. 
Each  data  point  represents  the  median  of  the  six  grade  level  ability  scores 
on  the  NRS  test.  The  pre  to  postest  gain  for  the  Study  II  students,  also  noted 
earlier,  was  from  4.5  to  8.1,  i.e.,  a gain  of  3.6  years  or  grades.  The  cor- 
responding gain  for  the  Study  III  students  was  from  4.7  to  8.6,  i.e.,  a gain 
of  3.9  years  or  grades.  It  may  be  noted  that  the  Study  III  students  almost 
perfectly  replicated  the  pre  to  posttest  gain  of  the  Study  II  students.  There 
was  a small  gain  for  the  Study  III  students  from  the  ADVANCED  PRETESTING  to 
the  PRETESTING,  1.3  which  suggests  some  improvement  due  to  repeated  testing. 
There  was  no  change  for  the  Study  II  students  from  the  POSTTESTING  to  the 
OELAYED-POSTTESTING,  which  suggests  stability  for  the  gains  over  time. 

These  data  seem  to  reinforce  the  conclusion  that  there  was  a gain  in 
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• • Study  ^ 3tud«nts 


AOVANCED  PRETEST  INC  POSTTESTING  DELAYED 

pretesting  posttesting 


P-q.  28.  Grade  level  scores  on  c*e  NRS  fo r the  Study  II 
and  Study  III  students  *nen  tested  under  ✓ar-ous  or<sm  and  oost- 
faining  conditions. 


reading  performance  as  a result  of  training  at  least  as  measured  by  a test  tna t 
involved  almost  exactly  the  same  type  of  reading  task  as  was  involved  in  the 
t ra i n i ng  itself. 

Fig.  29  contains  the  Ga tes-MacG i n i t ie  test  scores  as  well  as  the  NRS  test 
scores  for  comparison  purposes.  The  left  side  of  the  figure  contains  the  re- 
sults for  the  Study  ||  students,  and  the  right  side  contains  the  results  for 
the  Study  III  students.  Each  side  contains  the  results  for  the  December/ Janua ry 
testing  versus  the  April  Testing,  i.e.,  the  same  testing  periods. 

For  the  Study  II  students,  the  December/January  testing  is  the  POSTTESTING 
and  the  April  testing  is  the  DELAYED-POSTTESTI NG.  The  scores  for  the  Study  II 
S^  should  be  stable  between  the  two  testing,  and  they  were.  The  POSTTESTING 
scores  on  all  the  Gates  subtests  are  closely  clustered  around  grade  level  5 
while  the  cor  respond i ng  score  for  the  NRS  is  about  8.  Thus,  the  high  gain 
to  about  grade  level  8 reflected  by  the  NRS  for  the  Study  II  students  in  Fig. 

28  does  not  seem  to  generalize  to  other  indicators  of  reading  ability.  It 
is  not  surprising  that  the  Gates  Vocabulary  scores  were  not  higher,  i.e., 
around  grade  8,  because  the  training  was  not  focused  upon  vocabulary  training. 
However,  if  the  students  had  learned  to  read  more  efficiently  it  would  seem 
that  this  increase  in  ability  would  have  resulted  in  approximately  grade  8 
scores  on  the  Speed  and  Accuracy  subtest  or  even  the  Comprehension  subtest 
since  it  is  also  a speed  test.  (Note:  The  Ga tes-MacG i n i t ie  test  manual  gives 

two  grade  equivalent  scores  for  the  Speed  and  Accuracy  subtest,  the  Speed  score 
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Study  ^ Students 


Study  ITT  Students 


• . ‘(RS 

• - - - - ♦ Gates  VoceD 

•  -o  Gates  Como. 

4**  ‘ "1  Gates  Speed 
A 4 Gates  Accur 


A- 


> 

^ w Oece'noer  Apri  i 

January  (Oelayed* 

(Posttesting)  Posttesting) 


Gecenoer  April 

January  (Posttest  ng) 
(Pretest ' ng) 


TESTING  *EP 100 


TESTING  ?E» 100 


Pig.  29.  Grace  level  scopes  on  me  vAS  -eaoing  -etr  me  •*'e  suotes*s 
of  Gates-^acGini  t e meemq  'est  "'or  •xo  tes*  ng  periods  r»e  jraon  s •gr 
the  Study  ••  students  and  me  other  g-aon  * 'or  me  Studv  III  >tudsnrs. 


is  based  upon  the  number  attempted  and  the  Accuracy  score  is  based  upon  the  num- 
ber correct.)  The  data  from  the  Study  II  students  do  not  support  the  idea  that 
the  training  produced  a gain  in  general  reading  ability.  On  tf  . contrary,  these 
data  suggest  that  the  training  used  does  not  transfer  to  other  reading  tasks. 

The  April  testing,  i.e.,  the  DELAYED-POSTTESTI NG  da ta  simply  replicated  the  POST 
TESTING  data  thus  suggesting  that  these  results  were  reliable;  there  was  no 
training  administered  between  the  December/January  testing  and  the  April  testing 
for  the  Study  II  students,  and  there  was  also  very  little  change  in  the  scores 
during  this  period. 

For  the  Study  III  students,  the  Oecember/Janua ry  testing  was  the  PRETESTING 
data  and  the  April  testing  was  the  POSTTESTING  data.  These  data  indicate  that 
all  the  measures  of  reading  ability  are  in  agreement  in  estimating  the  reading 
ability  of  these  students  to  be  around  grade  4 or  5 prior  to  training,  i.e., 
the  PRETESTING  data.  After  training  however,  the  NRS  shows  a drastic  gain  to 
about  grade  8 while  the  Ga tes-Mac Gin i t i e subtests  show  little  or  no  gain  with 
all  scores  clustering  again  around  grades  4 and  5. 

The  preceding  transfer  data  may  be  summarized  as  follows: 

1.  The  subtests  on  the  Ga tes-MacG i n i t i e reading  test  indicated  that 
both  groups  of  students  had  about  a grade  level  5 average  in 
reading  ability  prior  to  and  also  subsequent  to  training,  i.e., 
the  Ga tes-MacG i n i t i e indicated  no  gain  from  grade  5 ability  as  a 
result  of  the  reading  training. 

2.  The  NRS  test  results  replicated  the  Ga tes-MacG i n i t ie  test  results 
prior  to  training  i.e.,  both  groups  of  students  average  around 

grade  level  5 ability  prior  to  training,  but  the  NRS  test  results 
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do  not  rer>lir.a'-e  the  Ga  res-MacG  in  i t ie  subsequent  to  training 
since  the  NRS  scores  showed  a gain  to  around  grade  8 for  both 

groups . 

3.  These  data  may  be  interpreted  as  indicating  that  the  reading  train- 
ing was  not  effective  in  increasing  general  reading  ability  but 
was  only  effective  in  increasing  the  ability  to  perform  the  pro- 
grammed prose  type  of  reading  task  that  was  used  in  training  and 
employed  in  the  NRS  test. 

The  reading  rate  data  for  the  first,  second,  third,  and  fourth  passages 
were  analyzed  separately,  initially.  That  is,  the  median  rate  for  the  six  stu- 
dents for  each  of  the  four  orders  was  calculated  and  then  the  mean  of  these  four 
median  rates  was  calculated  as  a measure  of  the  typical  rate  under  each  con- 
dition. For  the  Study  III  students,  the  resulting  value  was  121  Words  per  minute 
for  the  PRETESTING  and  144  Words  per  minute  for  the  POSTTESTING.  For  the  Study 
II  students,  the  resulting  value  was  15^  Words  per  min.  for  the  POSTTESTING  and 
168  Words  per  min.  for  the  DELAYED- POSTTEST  I NG . Thus,  the  training  effect  for 
the  Study  III  students  seemed  to  be  a gain  of  Words  per  min.  to  bring  them 

from  121  to  155  Wpm  and  make  them  equal  to  where  the  Study  II  students  were 
when  they  finished  their  training,  i.e.,  154  Words  per  min.  Yet,  this  gain 
is  difficult  to  interpret  since  there  was  no  direct  control.  The  Study  II  stu- 
dents gained  24  Words  per  min.  with  no  training  condition  in  between  and  this 
detracts  from  directly  interpretating  the  rate  gain  of  the  Study  III  students 
as  being  attributable  to  the  training. 

The  reading  rate  data  are  not  clear-cut  with  respect  to  providing  evidence 
either  for  or  against  the  training  being  effective  in  producing  a gain  in  read- 
ing ability  that  transfers  to  typical  reading  situation. 

SUMMARY  OF  TRAINING  EFFECTIVENESS  RESULTS 


Although  the  reading  rate  data  may  leave  some  room  for  doubt,  the  results 
of  the  Ga tes-MacG i n i t i e test  indicate  that  the  reading  training  used  in  this 
research  was  not  effective  in  producing  an  increase  in  general  reading  ability. 
If  there  was  such  a gain,  it  would  seem  to  have  been  small  at  least  in  com- 
parison to  the  large  gain  that  was  a rt i factua I I y reflected  by  the  NRS  test. 
Based  upon  all  of  the  evidence  presented,  it  seemed  reasonable  to  conclude 
that  the  60-70  hours  of  reading  training  administered  to  each  student  by  the 
PLATO  computer  terminal  was  minimally  effective  in  producing  gains  in  general 
reading  ability.  There  were  in  fact  large  gains  in  the  ability  to  perform 
the  programmed  prose  type  of  reading  task  that  was  utilized  in  the  training. 
However,  there  was  evidence  that  indicated  that  these  increases  in  ability  were 
largely  specific  to  this  task. 
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SUMMARY  AND  CONCLUSIONS 


The  da ta  presented  from  Study  I,  and  Study  II,  and  Study  III  all  indicated 
no  support  for  the  hypothesis  that  poor  readers  consist  of  two  types--those 
that  read  poorly  because  of  meager  reasoning  ability  and  those  that  read  poorly 
because  of  insufficient  reading  practice.  From  these  data  it  may  be  concluded 
that  if  a group  of  students  who  read  equally  poorly  are  divided  on  the  bas:s  of 
their  reasoning  ability,  the  low  group  will  gain  just  as  much  from  reading 
training  as  the  high  reasoning  ability  group. 

Superficially,  the  data  were  quite  definitive  with  respect  to  the  preceed- 
i ng  conclusion.  Data  supplementary  to  that  outlined  above,  however,  renders 
this  conclusion  questionable  at  best.  Part  of  this  supplementary  data  comes 
from  the  Raven  Progressive  Matrices  Test.  It  was  used  as  a screening  instru- 
ment for  separating  students  into  low  and  high  intellectual  ability.  The  re- 
liability and  validity  of  the  data  from  this  test  was  questioned  early  in  the 
research  and  additional  data  was  collected.  The  first  data  collected  provided 
evidence  for  the  validity  of  the  Raven;  the  Verbal  and  Performance  scores  on  the 
WISC  test  provided  constructive  replication  data  (see  Lykken,  1968)  for  the  Raven. 
The  Low  Raven  group  tended  to  score  low  on  both  the  Verbal  and  Performance  sec- 
tions of  the  WISC  thus  suggesting  low  potential  with  respect  to  gain  in  read- 
ing ability  as  a result  of  training.  The  High  Raven  group  tended  to  score 
higher  on  the  Performance  section  as  compared  to  the  Verbal  Section  thus 
suggesting  high  potential  with  respect  to  gain  in  reading  ability  as  a result 
of  training.  However,  the  validity  of  the  Raven  data  was  put  in  jeopardy  from 
another  direction.  The  test  was  repeatedly  given  under  several  conditions  wherein 
possible  variation  in  motivation  and  impusivity  was  designed  to  be  reduced  to 
a minimum.  Under  these  conditions,  the  differences  between  the  Low  Raven  group 
and  the  High  Raven  group  almost  evaporated  completely.  It  was  also  suggested 
that  the  WISC  data  would  be  similarly  affected  by  this  type  of  testing  control. 
Thus,  it  is  reasonable  to  question  whether  the  difference  between  the  two  reason- 
ing ability  groups  was  large  enough  to  be  important.  If  the  differences  bet- 
ween the  Low  Raven  groups  and  the  High  Raven  groups  were  in  fact  very  small 
with  respect  to  reasoninq  ability,  then  the  oriainal  hypothesis  guiding  this 
research  was  not  tested  and  the  preceeding  conclusion  is  questionable  at  best. 

Another  qualification  that  detracts  from  the  validity  of  the  conclusion 
drawn  at  the  outset  of  this  section,  involves  the  training  effectiveness  results. 
If  the  training  was  of  questionable  effectiveness  in  producing  a general  gain 
in  reading  ability,  then  any  conclusions  drawn  from  the  research  results  about 
the  relationship  between  reasoning  ability  and  gain  in  reading  ability  also 
become  highly  questionable  from  this  standpoint. 

There  was  one  aspect  of  the  research  results  that  indirectly  supported  the 
theoretical  rationale  given  at  the  outset.  Gain  in  the  efficiency  with  which 
the  students  could  perform  the  programmed  prose  task  on  the  practice  passage 
showed  great  variability  between  students  when  gains  in  performance  were  con- 
sidered with  respect  to  the  number  of  training  sessions  or  the  total  amount 
of  time  engaged  in  the  reading  training.  However,  when  the  gains  in  per- 
formance were  considered  with  respect  to  the  number  of  reading  passages  that 
had  been  mastered  to  a quality  criterion,  then  the  individual  differences  in 
gain  vanished. 

From  this  research  data  in  i ts  ent i re  i ty , it  seems  reasonable  to  conclude 
the  fol lowing: 

1.  The  Raven  Progressive  Matrices  Test  is  of  questionable  validity  for 
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measuring  the  intellectual  ability  of  poor  reading,  high  school 
students  unless  it  is  given  under  special  conditions  wherein  motivia- 
tion  can  be  manipulated  to  a high  level  and  impusivity  can  bn  reduced 
to  a low  I eve  I . 

2.  Use  of  the  programmed  prose  reading  task  as  a training  procedure  for 
poor  reading,  high  school  students  does  in  fact  produce  gains  in  ability 
to  perform  this  type  of  reading  task.  Unfortunately,  the  gains  in 

this  skill,  or  ability,  seemingly  do  not  transfer,  to  any  substancial 
degree,  to  other  types  of  reading  situations  that  may  be  more  common 
to  typical  reading  situations. 

3.  Individual  differences  seem  to  approach  a vanishing  point  with  respect 
to  gain  in  the  ability  to  perform  the  programmed  prose  reading  task 
when  gain  is  not  related  to  time  spent  mastering  the  task  but  is 
related  to  the  number  of  successfully  mastered  tasks. 
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IMPLICATIONS  AND  RECOMMENDATIONS 


This  section  contains  speculations  that  in  some  areas  go  well  beyond  the 
data  collected  in  the  present  research. 

Programmed  prose,  as  a training  technique  for  improving  reading  ability, 
seems  to  have  limited  potential.  The  present  research  indicates  that  it  is  not 
a panacea  for  improving  the  reading  ability  of  poor  reading,  high  school 
students.  The  fact  that  these  students  showed  gains  on  this  reading  task  in- 
dicates that  they  are  capable  of  learning  but  that  the  skill  learned  does  not 
readily  transfer  to  other  reading  tasks.  Thus,  it  would  seem  that  if  these 
students  are  capable  of  learning,  it  is  still  the  task  of  education  to  figure 
out  how  or  what  they  need  to  be  taught  in  order  for  them  to  become  average 
readers  instead  of  poor  readers.  The  present  research  results  suggests  that 
simple  practice  in  reading  words,  i.e.,  determining  which  words  belong  in 
sentences,  is  not  a sufficient  condition  for  improving  reading  ability  in  gen- 
eral. Thus,  it  would  seem  that  reading  practice  in  and  of  itself  is  of 
limited  usefulness  for  these  students. 

It  seems  that  the  general  advice  given  by  Smith  (1971;  1973)  regarding 
practice  and  reading  improvement  needs  to  be  refined.  Reading  practice  under 
feedback  conditions  does  not  seem  to  have  the  effect  suggested  by  Smith.  Pos- 
sibly Smith's  advice  is  still  good  advice  for  beginning  readers,  i.e.,  readers 
who  need  decoding  practice.  However,  those  readers  who  have  advanced  to  around 
grade  level  4 or  above  may  not  benefit  from  such  practice.  It  seems  more 
likely  that  the  poor  readers  who  have  advanced  this  far  are  only  going  to 
improve  their  general  reading  ability  by  improving  their  background  know- 
ledge or  experience.  If  reading  practice  means  that  the  individual  is  com- 
prehending thoughts  never  before  comprehended,  then  this  type  of  practice  is 
likely  to  be  effective  in  increasing  general  reading  ability.  However,  if 
reading  practice  simply  means  that  the  student  is  learning  which  words  belong 
in  sentences,  by  repeated  attempts  with  feedback,  this  type  of  practice  seems 
to  be  of  low  or  zero  effectiveness  in  improving  general  reading  ability.  It  is 
possible  that  certain  poor  readers  have  low  degrees  of  reasoning  ability  and 
this  in  turn  limits  their  potential  reading  ability.  However,  the  fact  that 
the  present  poor  reading, high  school  students  continued  to  improve  on  the 
Raven  tests,  all  the  way  up  to  grade  10-12  ability  levels,  when  motivation 
was  increased  and  impulsivity  was  decreased,  suggests  that  limited  reasoning 
ability  is  not  likely  to  be  the  primary  cause  of  their  poor  reading.  It 
seems  more  likely  that  the  cause  of  poor  reading  is  primarily  low  background 
knowledge.  Anyone,  including  college  graduates,  could  be  considered  as  poor 
readers  if  given  a comprehension  test  on  extremely  difficulty  material  in  a 
subject  matter  area  with  which  they  are  unfamiliar. 

It  would  seem  that  poor  reading  high  school  students  could  be  given  prac- 
tice in  reading,  as  was  the  case  in  this  research,  and  could  be  given  training 
in  how  to  think,  using  some  technique  approved  by  Thorndike,  and  still  not 
become  better  readers.  A more  likely  possibility  for  improving  their  reading 
ability  would  be  to  focus  upon  educating  them  i.e.,  providing  direct  and  vicarious 
cognitive  experiences  which  provide  background  knowledge,  or  schemas,  allowing 
them  to  better  understand  what  they  read  or  what  they  are  told. 

The  problem  then  becomes  circular.  The  best  way  to  become  a better  reader 
is  to  gain  more  background  knowledge  about  the  material  that  one  might  be 
called  upon  to  read,  and  the  best  way  to  gain  this  knowledge  is  by  reading. 

The  solution  to  this  circularity  problem  probably  lies  in  subject  matter  specializa- 
tion. Rather  than  trying  to  get  the  poor  readers  to  become  better  readers  in 
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general,  try  to  get  them  to  become  better  readers  with  respect  to  a specific 
subject  matter  area.  For  example  a high  school  student  who  wanted  to  become 
an  auto  mechanic  could  be  given  reading  instruction  using  books  and  manuals 
dealing  with  automobile  repair.  This  is  the  instructional  strategy  that  was 
advocated  and  implemented  by  Sticht  (1975)  with  respect  to  reading  training 
in  the  U.S.  Army.  The  present  research  has  not  resulted  in  evidence  for 
a viable  alternative  to  this  approach.  Probably  the  best  strategy  to  use  to 
improve  the  reading  ability  of  poor  readers  is  to  concentrate  on  making  these 
students  better  readers  in  a specific  subject  matter  area  and  give  up  trying  to 
make  them  better  readers  in  general.  This  means  that  the  educational  system 
is  likely  to  be  able  to  help  poor  reading,  high  school  students  become  better 
readers  of  automobile  repa i r manuals,  for  example.  Vet,  no  one  should  expect 
successful  achievement  of  this  goal  to  result  in  considerably  better  general 
reading  ability  as  reflected  by  a standardized  reading  test  such  as  the  Gates- 
MacG i n i t i e . 


When  the  present  research  was  conceived,  it  was  perceived  that  if  the  Type 
II  poor  reading  high  school  students  actually  existed  and  could  be  isolated 
using  the  Raven  test,  then  they  could  be  turned  into  good  readers  using  modern 
technology,  PLATO  IV,  to  administer  reading  practice.  Thus,  it  was  disappointing 
from  a practical  standpoint  to  find  that  the  reading  training  resulted  in  little 
or  no  improvement  in  general  reading  ability. 

The  present  results  may  be  interpreted  as  suggesting  that  the  ideas  of 
Thorndike,  and  the  refinements  of  those  ideas  as  expressed  in  the  Type  I and 
Type  II  poor  reader  hypotheses  that  guided  the  present  research,  are  either 
wrong  or  too  simplistic.  The  idea  that  simple  practice  in  reading  with  feed- 
back will  redeem  poor  readers  found  no  support  in  the  present  research.  Yet, 
the  fact  that  the  poor  readers  did  gain  in  reading  proficiency  on  the  programmed 
prose  task  without  any  direct  training  in  intellectual  functioning,  suggests 
that  meager  intellectual  ability  is  not  the  sole  cause  of  poor  reading  as 
Thorndike  seems  to  suggest.  Furthermore,  the  large  gains  made  by  the  poor 
readers  on  the  Raven  test,  up  to  grades  10-12  ability,  without  any  direct 
training  in  thinking  or  strategies  (other  than  test  taking  controls)  also 
seems  to  provide  evidence  against  the  idea  that  their  poor  reading  was  prim- 
arily due  to  meager  reasoning  ability. 

In  the  beginning,  it  was  noted  that  Thorndike  suggested  that  if  we  want 
better  readers  then  we  should  develop  better  ways  of  teaching  people  to  think 
rather  than  concentrating  on  reading.  This  approach  does  not  seem  to  have 
a solid  theoretical  rationale  supporting  it,  and  empirical  evidence  to  sup- 
port it  seems  to  be  almost  exclusively  correlational  rather  than  causal  or 
exper imenta I . On  the  contrary,  the  present  data,  although  meager,  suggest 
that  direct  efforts  in  trying  to  teach  people  to  think  would  not  likely  be 
a successful  way  of  helping  poor  readers  become  better  readers.  On  the  other 
hand,  the  idea  directly  investigated  in  the  present  research  does  not  seem  to 
hold  much  potential  either,  i .e.  , practicing  reading  does  not  seem  to  improve 
the  reading  ability  of  poor  readers.  Thus,  it  seems  that  the  only  way  left 
for  the  vast  majority  of  the  poor  readers  in  the  United  States  to  improve  their 
reading  ability  is  to  improve  their  background  knowledge  relevant  to  what 
they  are  reading.  Since  the  best  way  to  increase  background  knowledge  relevant  to 
a specific  reading  passage  is  usually  to  read  other  material  that  is  relevant 
to  the  comprehension  of  that  passage,  the  potential  for  helping  most  poor 
readers  appears  to  be  quite  dismal.  There  appears  to  be  no  direct  training 
procedures  that  will  help  in  any  general  way  since  reading  improvement  can 
almost  be  likened  unto  the  difficulty  of  lifting  oneself  by  one's  own  boot- 
straps. Of  course,  gain  in  reading  ability  is  not  quite  that  difficult, 
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otherwise  there  would  not  be  so  many  good  readers.  Gain  in  knowledge  and  gain 
in  reading  ability  seem  to  be  highly  related  in  our  society,  at  least  by  the 
time  the  student  reaches  the  point  where  he/she  can  comprehend  by  reading 
almost  everything  that  can  also  be  comprehended  by  auding.  From  this  point 
on,  a small  gain  in  knowledge  results  in  a small  gain  in  reading  ability  and 
that  small  gain  in  reading  ability  may  be  used  to  effect  another  small  gain  in 
knowledge.  This  theorized  interplay  between  gains  in  knowledge  and  gains  in 
reading  ability  seems  to  explain  why  the  present  research  failed  to  produce 
a substantial  gain  in  general  reading  ability.  The  present  research  did  not 
focus  upon  a gain  in  knowledge  by  somehow  forcing  the  students  to  comprehend  the 
thoughts  in  the  reading  material.  Furthermore,  this  theorized  relationship 
also  predicts  failure  for  training  procedures  which  focus  directly  upon  some 
type  of  thinking  improvement  as  a means  for  increasing  reading  ability.  If 
gain  in  reading  ability  is  closely  related  to  gain  in  knowledge,  then  general 
intellectual  functioning  will  have  a decidedly  secondary  influence,  if  at  all. 

In  closing,  the  final  implications  of  the  empirical  results  and  theoretica 
ideas  presented  in  this  research  report  will  be  presented.  These  implications 
are  quite  speculative;  they  represent  the  considered  opinions  of  one  researcher 
about  an  applied  area  which  lacks  definitive  research  results. 

The  reading  training  for  poor  readers  who  are  reading  at  least  as  high 
as  the  fourth  grade  level  on  a standardized  reading  test  should: 

1.  focus  upon  increasing  subject  matter  knowledge  and  increasing  reading 
ability  at  the  same  time  using  the  same  training  material  for  both 

pu  rposes . 

2.  not  use  training  materials  that  are  questionable  from  a gain  in  back- 
ground knowledge  standpoint,  e.g.,  (a)  certain  comic  book  material  and 
magazine  material  presentedly  used  for  reading  training  may  be  justifi 
able  from  a motivational  standpoint  but  may  not  contribute  much  know- 
ledge relevant  to  future  material  that  the  student  needs  or  wants  to 
be  able  to  read,  (b)  decoding  rules  and  workbook  materials  usually 
have  little  impact  upon  knowledge  and  therefore  are  likely  to  be 
extremely  inefficient  with  respect  to  increasing  general  reading 
ability. 

3.  be  directed  toward  a specific  subject  matter  area  that  either  the 
student  or  the  teacher  deems  as  directly  relevant  to  the  type  of 
reading  material  that  the  student  is  likely  to  encounter  in  the 
future. 

4.  not  focus  upon  so  called  reading  "skills"  at  the  expense  of  gain  in 
subject  matter  knowledge  but  instead  should  elevate  gain  in  knowledge 
as  a goal,  at  least  until  it  equals  if  not  exceeds  the  focus  upon 
traditionally  taught  skills  in  reading. 
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Abstract 


The  psychomet r ica I I y developed  Raven  Progressive  Matrices  Test  was 
rescaled  so  as  to  provide  an  interval  scale  that  would  be  aopropriate 
for  use  in  situations  where  an  edumetric  test  was  needed.  The  scale  was 
developed  from  a sample  of  666  individuals  ranging  from  Grade  3 to  col- 
lege students  who  had  been  administered  the  Raven.  A Rescaled  Raven 
scoring  system  was  developed  which  provided,  in  effect,  a weighted  score 
based  upon  the  relative  difficulties  of  the  items  that  were  scored  as 
correct.  The  Rescaled  Raven  scores  were  compared  to  the  original  scores 
in  Grades  3“12,  and  the  resulting  functional  relationships  were  inter- 
preted as  indicating  that  the  Rescaled  Raven  does  provide  an  interval 
scale  and  can  he  used  to  provide  valid  change  and  gain  scores. 
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edumctrlc  test.  Psychometric  tests  have  been  designed  to  reflect  differ- 


contains  the  ranked  difficulty  of  the  60  Items.  I choice  test  and  some  Items  may  be  answered  correctly  by  chance  alone. 
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also  calculated,  l.e.,  l-g.  and  these  "easiness"  values  were  used  for  the 
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puter  program  was  written  and  used  to  derive  the  Rescored  Raven  scores 
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Determining  the  Rescaled  Raven  Scores  from  the  Rescored  Raven  Scores 
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Fig.  2.  The  2S*h.  $Oth  and  /$ 
cent  lies  for  each  schtx>l  grade. 
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Fiq.  4.  Hw  2Slh,  ^Oth,  and  /5th  Rescaled  Raven  per- 
4 entiles  for  each  school  grade. 


Oi  it  ll*e  case  with  the  regular  clo/e  lost,  a word  is  added  ever/  fifth  word  so  ll*e  lost  is  to 

Intellectual  Ability  and  Reading:  Comparing 

Actual  Reading  Ability  with  f xpected  Reading  Ability  choose  which  of  tl*e  two  words  belongs  (Corver,  1975).  Ihis  tost  reduces  inference  and  other 
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I he  bottom  half  of  each  9.0*  (See  Appendi,  A).  This  was  inle.pteled  at  suggesting  that  the  top  '«»•»*  ave,°^  KO,e  f"  »,ud«",‘  •"  «ach  9'<‘dc  i.  genctoll,  nea.  It*;  SOlh  peicentile. 

half  of  I lie  c loss  could  daft  to  school  at  age  4 and  the  bottom  hot!  at  age  8 and  this  would  lend  ,he  ,c,*°o1  •»  ">oslly  Itodilional  will,  ocound  25-35  students  in  a tegului  classtaocn. 
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The  school  system  is  a small  town,  ratal  school  located  in  the  midwest.  On  other  standardized 


0-100  on  an  (‘qua I inteivol  basis  (See  Appendix  A).  The  Rescaled  Raven  scene  was  dcreimineJ 
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Intellectual  Ability 


Appe 

Page 


pcitancy  level.  However,  the  scores  from  the  bottom  half  ol  lire  class  were  not  as  expected.  as  well  as  could  be  expected  in  lire  lower  guides,  catclies  up  to  tlreir  expected  ability  in 

flteie  oppeofs  to  be  no  tendency  for  ll»ose  in  the  lower  ball  of  the  class  to  do  worse  than  what  the  middle  grades  and  then  exceeds  their  expected  ability  in  lire  upf>er  grades.  Thus,  the 


Intellectual  Ability  Intellectual  Ability 
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should  they  receive  special  attention.  Furthermore,  it  seems  fruitless  to  expect  lliese  students 
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stuJents  ore  reading  far  below  llreir  expected  leva!.  Therefore,  it  would  seem  aftproprinte 
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